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Preface 



Switched control systems have attracted much interest from the control commu- 
nity not only because of their inherent complexity, but also due to the practical im- 
portance with a wide range of their applications in nature, engineering, and social 
sciences. Switched systems are necessary because various natural, social, and engi- 
neering systems cannot be described simply by a single model, and many systems 
exhibit switching between several models depending on various environments. Nat- 
ural biological systems switch strategies in accordance to environmental changes 
for survival. Switched behaviors have also been exhibited in a number of social 
systems. To achieve an improved performance, switching has been extensively uti- 
lized/exploited in many engineering systems such as electronics, power systems, 
and traffic control, among others. 

Theoretical investigation and examination of switched control systems are aca- 
demically more challenging due to their rich, diverse, and complex dynamics. 
Switching makes those systems much more complicated than standard systems. 
Many more complicated behaviors/dynamics and fundamentally new properties, 
which standard systems do not have, have been demonstrated on switched systems. 
From the viewpoint of control system design, switching brings an additional degree 
of freedom in control system design. Switching laws, in addition to control laws, 
may be utilized to manipulate switched systems to achieve a better performance of 
a system. This can be seen as an added advantage for control design to attain certain 
control purposes. 

On the one hand, switching could be induced by any unpredictable sudden 
change in system dynamics/structures, such as a sudden change of a system struc- 
ture due to the failure of a component/subsystems, or the accidental activation of any 
subsystems. On the other hand, the switching is introduced artificially to effectively 
control highly complex nonlinear systems under the umbrella of the so-called hybrid 
control. In both cases, an essential feature is the interaction between the continuous 
system dynamics and the discrete switching dynamics. Such switched dynamical 
systems typically consist of sets of subsystems and switching signals that coordi- 
nate the switching among the subsystems. 

In this book, we investigate the stability issues under various switching mecha- 
nisms. For a controlled switching, the switching signal is a design variable just as 
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the control input in the conventional systems. It is measurable and can be freely 
assigned. In this case, the stability is in fact a kind of stabilization by stabilizing 
switching design. For an arbitrary switching, the switching signal is blind and un- 
controlled, and the stability is in fact a kind of robustness against the switching per- 
turbations. Besides the two extreme cases, the switching signal could be constrained 
in that it is neither controlled nor free arbitrarily. In other words, partial information 
is known about the switching mechanism. Typical constrained switchings include 
(i) autonomous switching, where the switching signal is generated autonomously 
with a preassigned state-space-partition-based switching mechanism; (ii) dwell-time 
switching, where the minimum duration on each subsystem is known and positive; 
and (iii) random switching with a known stochastic distribution. Switched systems 
under various constrained switching might behave in a rich, diverse and complex 
manner. 

The objective of this book is to present in a systematic manner the stability 
theory of switched dynamical systems under different switching mechanisms. By 
bringing forward fresh new concepts, novel methods, and innovative tools into the 
exploration of various switching schemes, we are to provide a state-of-the-art and 
comprehensive systematic treatment of the stability issues for switched dynamical 
systems. 

The book is organized in five chapters. Except for Chap. 1 that briefly introduces 
the problem formations and the organization of the book, subsequent chapters ex- 
ploit several important topics in detail in a timely manner. 

In Chap. 2, we focus on the guaranteed stability analysis of switched dynam- 
ical systems under arbitrary switching. As global uniform asymptotic stability is 
equivalent to the existence of a common Lyapunov function of the subsystems, the 
Lyapunov approach plays a dominant role in the stability analysis. For switched lin- 
ear systems, due to the fact that quadratic Lyapunov candidates are insufficient for 
coping with stability, emphasis is laid on the sets of functions which are universal in 
the sense that each asymptotically stable system admits a Lyapunov function from 
the function set. Both piecewise linear functions and piecewise quadratic functions 
are proven to be universal, and their connections to algebraic stability criteria are 
also established. We also pay much attention to the algebraic theory of discrete-time 
switched linear systems, where the stability is elegantly characterized by the spec- 
tral radius of the matrix set, which generalizes the standard matrix spectral theory. 
While determining the spectral radius has been proven to be A^P-hard, we introduce 
the homogeneous polynomials to serve as common Lyapunov functions and utilize 
the sum-of-squares technique and the semi-definite programming to approximate 
the spectral radius. Finally, the more subtle issue of marginal stability is carefully 
examined, and its connection to the common weak Lyapunov function is established. 
We reveal that marginal stability admits a block triangular decomposition with clear 
spectral information, and this leads to an invariant set viewpoint for characterizing 
marginal stability and marginal instability. 

Chapter 3 presents stability theory for switched dynamical systems under con- 
strained switching. There are three types of constrained switching addressed in this 
chapter. The first type of constrained switching is the random switching with a pre- 
assigned jump distribution. When the subsystems are linear and the switching is 
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governed by a Markov process, the switched linear system is known to be a jump 
linear system. We introduce various stability concepts and their criteria, and estab- 
lish the connections to the guaranteed stability criteria in Chap. 2. The second is the 
piecewise affine systems where the state space is partitioned into a set of polyhedral 
cells, each relating to a subsystem, and hence the switching is totally autonomous. 
The piecewise quadratic Lyapunov approach, the surface Lyapunov approach, and 
the transition graph approach are introduced. The pros and cons of the approaches 
are compared and discussed. The third type of constrained switching is the dwell- 
time switching, where the switching duration between any two consecutive switches 
admits a positive lower bound. We address both the stability analysis, where the 
dwell time is preassigned, and the stabilizing switching design, where the minimum 
or maximum dwell time is to be designed. The design captures the capability and 
the limitation of the switching mechanism. 

Chapter 4 is devoted to the stabilizing switching design for switched dynamical 
systems under controlled switching. It is proven that a switched Lyapunov function 
exists if the system is globally asymptotically stabilizable. However, counterexam- 
ples exhibit that even stabilizable planar switched linear systems may not admit 
any convex switched Lyapunov function. To overcome the intrinsic difficulty, we 
introduce a class of nonconvex functions known as min functions that are piece- 
wise quadratic and prove that each stabilizable switched linear system admits a 
min function as a switched Lyapunov function. To further address the stabilizabil- 
ity and robustness of switched linear system, we propose a pathwise state-feedback 
switching strategy, which accounts to concatenating a finite number of switching 
paths based on appropriate partitions of the state space. By aggregating the over- 
all system into a discrete-time piecewise linear system, we are able to prove that 
the switching strategy exponentially stabilizes the original switched linear system 
whenever it is asymptotically stabilizable. We develop a computational procedure 
to calculate a stabilizing pathwise state-feedback switching law for an asymptot- 
ically stabilizable switched linear system. To further investigate the robustness of 
the pathwise state-feedback switching strategy, we define a (relative) distance be- 
tween two switching signals and prove that the closed-loop system is robust against 
structural/unstructural/s witching perturbations . 

With the stability theory presented in the previous chapters, we further exploit its 
connections and implications to several fundamental control problems in Chap. 5. 
For absolute stability of Lur'e systems, an elegant connection to the guaranteed sta- 
bility of switched linear systems is established. Utilizing this connection, computa- 
tional algorithms are presented to verify absolute stability for planar Lur'e systems. 
Another implication of the guaranteed stability criteria is the consensus analysis of 
multiagent systems with dynamic neighbors, and exponential agreement is reached 
if the graph is always strongly connected. For an intelligent system with linear local 
controllers and a fuzzy rule, it is naturally converted into a piecewise linear system, 
and hence the stability analysis can be conducted by means of the stability criteria 
presented in Chap. 3. This brings a new design method and a fresh observation to 
the fuzzy control problem. For a SISO linear process with unknown parameters, an 
adaptive control framework is established based on appropriate partitions of the pa- 
rameter space and proper stabilizing switching strategy among the local controllers 
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which are designed to stabilize the system in a local sense. Finally, for control- 
lable switched linear systems, a multilinear feedback design approach is proposed 
to tackle the stabilization problem. The main idea is to associate a set of candidate 
linear controllers with each subsystem, such that the extended switched system is 
stabilizable. By utilizing the pathwise state-feedback switching design diagram, the 
problem of stabilization is solved in a constructive manner. 

The book is primarily intended for researchers and engineers in the system and 
control community. It can also serve as complementary reading for nonlinear system 
theory at the postgraduate level. 
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Chapter 1 
Introduction 



1.1 Switched Dynamical Systems 

Generally speaking, a switched dynamical system is a dynamical system in which 
switching plays a nontrivial role. More specifically, a switched dynamical system is 
a two-level hybrid system with the lower level governed by a set of modes described 
by differential and/or difference equations and the upper level a coordinator that 
orchestrates the switching among the modes. Clearly, the system admits continuous 
states that take values from a vector space and discrete states that take values from a 
discrete index set. The interaction between the continuous and discrete states makes 
switched dynamical systems widely representative and complicatedly behaved. 
A forced-free switched dynamical system is mathematically described by 

x + (t) = f a {x(t)), (1.1) 

where x e R" is the continuous state, a is the discrete state taking values from 

an index set M — {1, . . . , m], and fy, k e M, are vector fields. x + denotes the 
derivative operator in continuous time (i.e., x + (t) — -jjx(t)) and the shift forward 
operator in discrete time (i.e., x + (t) — x(t + 1)). 

It is clear that the continuous state space is the n -dimensional Euclidean space, 
and the discrete state space is the index set M with a finite number of elements. The 
time space is either the set of real numbers in continuous time or the set of integers 
in discrete time. According to the continuous or discrete nature of the time space, 
the switched system is said to be continuous-time or discrete-time. As there are m 
subsystems, the system is also termed as m-form switched system. 

In the system description, each individual mode 

x + {t) = f k (x(t)) (1.2) 

for k e M is said to be a subsystem of the switched system. The discrete dynamics 
represented by the switching coordinator is usually called the supervisor. The super- 
visor produces the discrete state a , also known as the switching signal or switching 
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2 1 Introduction 

law. If er(f) = i, then we say that the fth subsystem is active at time t. A character- 
istic of a switched system is that at a time instant there is one (and only one) active 
subsystem. Another characteristic is that the continuous state evolves continuously, 
that is, the state does not "jump" in an impulsive way. 

As we treat continuous-time systems and discrete-time systems in a unified 
framework, the time space, denoted by T, may either be the real set (T = R) or 
the integer set (T = N). For a real number s, let % be the set of times that are 
greater than or equal to s, i.e., % — {t e T : t > s}. For two real numbers t\ and t 2 
with t\ < t2, the time interval [t\, t 2 ) should be understood as 

[ti,tz) = {t^T:t>h, t <t 2 }. 

Other types of time intervals should be understood in a similar manner. The mea- 
sure of [fi, t 2 ) is the length t 2 — t\ in continuous time and the cardinality #[t\, t 2 ) 
in discrete time. For notational convenience, we take any function defined over a 
discrete time set to be sufficiently smooth. For a piecewise continuous function x 
defined over a time interval [t\ , t 2 ) and for a time t e (fi , t 2 ), define 

X(/+) = limxO), xO-) = limxCO 

s\.t iff 

in continuous time and 

/(?+) = x(? + D, x(t-) = x(t-i) 

in discrete time. 

As can be seen from the system description, when subsystems (1.2) for k — 
1 , . . . , m are given, the dynamical behavior of the switched system is decided by 
the switching signal. In the literature, a switching signal is also termed as a switch- 
ing path or a switching law. For clarity, in this book we distinguish the terminologies 
as follows. 

A switching path is a right-continuous function defined over a finite time interval 
taking values from the index set, M. Given a time interval [to, tf) with — oo < to < 
tf < +oo, a switching path p defined over the interval is denoted P[t ,t f ). For a 
switching path P[t ,t f ), time t G (to, tf) is said to be a jump time instant if 

a(t-)^cj(t). 

Suppose that the ordered sequence of jump instants in (to, tf) is t\ < t 2 < t% < ■ • ■ . 
Then, the ordered sequence to, h, t%, • ■ ■ is said to be the switching time sequence of 
a over [fo, tf). Similarly, the ordered discrete state sequence er(?o), o(t\), cr(t 2 ), . . . 
is said to be the switching index sequence of a over [fo, tf). The sequence of ordered 
pairs 

(to, io),(h, h), ■■■,&, is) 

is said to be the switching sequence of a over [fo, tf). The switching path is said to 
be well defined if there are a finite number of jump times within the interval. The set 
of well-defined switching paths defined over [fo, tf) is denoted by S[ t[) j f ). 
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A switching signal is a function defined over an infinite time horizon taking val- 
ues from M . Suppose that 9 is a switching signal defined over [to, +00), and [s[ , S2) 
is a finite-length subinterval of [to, +00), then, a switching path P[ S1 ,sz) * s sa id to ^ e 
a subpath of 9 if pit) — 9 (?) for all t e[si, s 2 )- The notion of switching time/index 
sequences could be defined in the same way as for the switching path. A switch- 
ing signal is said to be well defined if all its subpaths are well defined. We denote 
by 9[ tQ+00 ) the switching signal 9 defined over [to, +00). The set of well-defined 
switching signals defined over [to, +00) is denoted by iS[ f0i+OO ) or S in short when 
?o = 0. 

Given a function pair (x(-), 9(-)) over [to, ?i), where x : [to, t\) i-> R" is abso- 
lutely continuous, and 9 : [to, t\) \-> M is piecewise constant. The pair (x(-), #(■)) is 
said to be a solution of system (1.1) over [to, ?i) if for almost all t G [to, t\), we have 

x + (t) = fe (t )(x(t)). 

The term "for almost all t e [to, ?i)" means that "for all t e [to, t\) except for possi- 
bly a zero-measure subset". The solution over other types of time intervals, such as 
[to, t\] and [to, +00), should be understood in the same way. 

Switched system (1.1) is said to be (globally) well defined if for any 9 e 5[o,+oo) 
and xo € R", there exists a unique absolutely continuous function x on [0, +00) 
wifhx(O) — xo such that pair (x(-), 9(-)) is a solution of system (1.1) over [0, +00). 
It is clear that, when each subsystem satisfies the Lipschitz condition, i.e., 

lim sup \fk(xi)- fk(x 2 )\/\xi -x 2 \ <+oo, IceM, 

then, the switched system is always well defined. Throughout the book, we assume 
that the Lipschitz condition holds for the subsystems, and thus the well-definedness 
of the switched system is guaranteed. 

For the switched system, a switching law is a switching rule that generates a 
switching path or a switching signal for a set of initial configurations. Throughout 
the book, we consider switching laws in the form 

<T(t) = cp(t,a(t-),x(t)), (1.3) 

where <p is a piecewise constant function taking values from M. A function x(-) 
is said to be a (continuous) state trajectory of system (1.1) via the switching law 
(1.3) over [to, ft) if both equations (1.1) and (1.3) hold for almost all t e [to, t\). 
The corresponding switching path/signal a is said to be generated by the switching 
law (1.3) along jc(-) for initial state xo over [to, t\). 

A switching law is said to be well defined if it generates a well-defined switch- 
ing signal for any initial state. As a result, for switched system (1.1), a well-defined 
switching law can be represented by the set {9 X : x e R"}, where 9 X is the well- 
defined switching signal generated by the switching law with initial state x. An- 
other implication is that the switched system admits a unique solution for any initial 
configuration when both the switched system and the switching law are well de- 
fined. For notational convenience, the continuous state trajectory will be denoted by 
(/>(•; fo>*0. CT ) or (pi'', x o, &) m short when to = 0. 
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1.2 Stability and Stabilizability of Switched Systems 

When the dynamics of the subsystems are known, the behaviors of the switched 
system are totally decided by the switching mechanism. A notable and attractive 
feature of switched systems is that the switched system might produce complex and 
diverse behaviors, even with simple and fixed subsystems. In this book, we aim to 
develop stability theory for switched dynamical systems under various switching 
mechanisms. To this end, we need to introduce the concepts of stability and stabi- 
lizability for switched dynamical systems. 

Let T = {A x : x e R"}, where A x is a nonempty subset of S, the set of well- 
defined switching signals. The set, called the feasible set of switching signals, as- 
signs each initial state a set of switching signals. This set induces a feasible set of 
continuous state trajectories defined by {T x : x e R"}, where r x is the set of state 
trajectories with initial state x and switching signals in A x , i.e., 

r x = {<£(■; 0,x, (9) :6>e7l A '}. 

To proceed, we need to introduce some mathematical notation. A real-valued 
function a : R + \-> R + is said to be of class K if it is continuous, strictly increasing, 
and a(0) — 0. If in addition, a is unbounded, then it is said to be of class /C^. 
A function /J : R + x R + i->- R_|_ is said to be of class ICC if /?(•, t) is of class K for 
each fixed t > and lim^+oo /3(r, t) — for each fixed r > 0. 

Definition 1.1 (Stability) Suppose that T = {A x : x e R"} is a feasible set of 
switching signals. Switched system (1.1) is said to be 

(1) stable w.r.t. T if there exist a class K, function £ and a positive real number S 
such that 

\(p(t;0,x ,9)\ <f(|*ol) Vf e [0, +oo), x e B s , e A x ° 

(2) asymptotically stable w.r.t. T if there exists a class ICC function § such that 

\<Kt;0,xo,e)\<$(\xo\,t) Vre[0,+oo), x e R", 6 e A x ° 

and 

(3) exponentially stable w.r.t. T if there exist positive real numbers a and /3 such 
that 

\<p(t,0,xo,e)\ <Pe- at \x \ Vre[0,+oo), x eR n , 9 e A x ° 

Note that the stability is uniform w.r.t. switching signals and that asymp- 
totic/exponential stability is defined in a global fashion. 

Definition 1.2 (Stabilizability) Suppose that T — {A x : x e R"} is a feasible set of 
switching signals. Switched system (1.1) is said to be 
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( 1 ) stabilizable w.r.t, T if there exist a class K function £ , a positive real number S , 
and a switching law {6 X :ieR"| with 6 X e A x such that 

\<p(t; 0, x , X °) | < S (|* |) Vf e [0, +00), x e B^ 

(2) asymptotically stabilizable w.r.t. T if there exist a class /C£ function § and a 
switching law {9 X :x eR n } with 0* e A x such that 



|0(/; 0, jcq,^^ )! <t;(\x \,t) Vt e[0,+oo), jc e R" 



and 



(3) exponentially stabilizable w.r.t. T if there exist positive real numbers a and /3 
and a switching law {9 X : x eR n } with 0* e yl" 1 such that 

\(p(t;0,x Q ,e xo )\<Pe- c "\xo\ We[0,+oo), x € R" 

When the subsystem dynamics are fixed, the stability property is totally deter- 
mined by the feasible set of switching signals. In particular, if T\ 3 7" 2 , then stability 
w.r.t. T\ implies stability w.r.t. T2, and stabilizability w.r.t. T2 implies stabilizability 
w.r.t. T\ . 



1.2.1 Guaranteed Stability Under Arbitrary Switching 



When the supervisory mechanism is totally blind, that is, switching among the sub- 
systems can occur in an arbitrary way, then the stability is said to be guaranteed 
stability. The feasible set of switching signals is given by 



T as = \A x :xeR n }, A X = S, WxeR". 



(1.4) 



As the feasible set is the largest one among all the feasible sets, guaranteed stability 
is the most strict among various stability notions. In fact, as will be revealed later, 
it is robust against any arbitrary switching mechanism. In particular, guaranteed 
stability implies stability of each subsystem. The converse is not necessarily true, as 
exhibited by the following example. 

Example 1.1 Suppose that we have two planar linear subsystems 



and 









-I -3a 



1 



1 
-I — a 



where a is a nonnegative real parameter. Clearly, both subsystems are exponentially 
stable and in a companion form. When a — 0, the two subsystems coincide, and 
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Fig. 1.1 Phase portraits and switching surfaces 



the switched system is guaranteed exponentially stable. When a » 36.512, the 
switched system is guaranteed marginally stable (i.e., stable but not asymptoti- 
cally stable). When a > 36.512, the switched system is not guaranteed stable. 
Figure 1.1 depicts the phase portraits (all initiated from xq — [—1/3, l] T ) of the 
switched system under the most destabilizing switching law that is shown in the 
upper left, which produces worst state trajectories that diverge as fast as possi- 
ble. 



1.2.2 Dwell-Time Stability 



A switching signal is said to be with dwell time x if f;+i — t{ > X for any two 
consecutive jump times t, and ?,_|_i. Let S T be the set of well-defined switching 
signals with dwell time x. It is a clear that S — So 3 S T1 3 S T2 for < x\ < %%, and 
the subset relations are strict when < x\ < x%. 

The set of arbitrary switching signals, S, allows the supervisor to switch arbitrar- 
ily fast even without a uniform (positive) dwell time between the switching times. 



1.2 Stability and Stabilizability of Switched Systems 
For instance, the switching signal 



)(t) 



| 1 iff €[£,£+ ^L), k = 0, 1,2,..., 
1 2 otherwise 



is well defined, but the length of the switching duration [k, k + -A^) approaches 
zero as k approaches infinity. It is clear that this switching signal belongs to iSo, but 
it does not belong to any S T when t > 0. 

Fix a nonnegative t. Let the feasible set of switching signals be 

r T = {yl*:*eR"}, A x = S T , V* eR". 

The stability of the switched system w.r.t. T T is termed to be r -dwell-time stability. 
It is clear that a necessary condition for r -dwell-time stability is that each subsys- 
tem is stable. The converse is partly true in that, if each subsystem is exponentially 
stable, then the switched system is also r -dwell-time exponentially stable for suffi- 
ciently large r . Indeed, exponential stability of the subsystems implies the existence 
of a time T > such that 

\<t>i(f,x Q )\<-\x \ Vr eT T , x eR", 

where </>,•(•; xq) denotes the state trajectory of the ;'th subsystem with x(0) = xq. It 
can be seen that the switched system is T-dwell-time exponentially stable. However, 
the assertion is not necessarily true for marginal or asymptotic stability. For instance, 
for the planar switched linear system with two marginally stable subsystems 



1 

-2 



and 

1' 

-1/2 

the switched system is unstable if we take the first subsystem when the state is in the 
second and fourth quadrants, and take the second subsystem otherwise. The lower 
left picture of Fig. 1 .2 depicts a sample phase portrait of the switched system under 
the switching law. As the orbits for each subsystem are periodic, by incorporating 
one or more periods into each switching duration, the state keeps diverging, see the 
lower right picture of Fig. 1.2, where a period is incorporated in each switching 
duration. This implies that, for any r > 0, the feasible set T r contains destabilizing 
switching signals. 

According to the above analysis, for dwell-time stability, the problem is to find 
a dwell time t as small as possible such that the switched system is r -dwell-time 
stable. 
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Fig. 1.2 Phase portraits of the switched marginally stable system 




1.2.3 Autonomous Stability Under State-Driven Switching 



Let y : R" h> M be a piecewise constant function mapping the continuous state 
space into the discrete state space. Its inverse map, denoted y~ l , is defined so that 
y(y _1 (/)) = i for every i e Imy, the image set of y. Map y induces a switching 
law given by 



a(t) = y(x(t)), 



(1-5) 



which is state driven. When the switching law is well defined, it generates a fea- 
sible set of switching signals, denoted T y . The switched system is said to be 
y -autonomously stable if it is stable w.r.t. the feasible set T y . 

For a switched system with a state-driven switching, switches occur au- 
tonomously as the continuous state evolves. For an initial state, the switching 
law might generate a unique switching signal when it is well defined, or a dead- 
lock might happen that prevents the switching from well-defined. Therefore, well- 
definedness is an important issue to be addressed. Another difficulty is the need to 
extend the solution concept to cope with possible sliding modes. While we will not 
go into details of the issues in the book, these indicate that the system behavior 
might be quite complex. 



1.2 Stability and Stabilizability of Switched Systems 9 

When each y~ l (i) is a convex polyhedron (or the empty set) and each subsystem 
is affine, the switched system is known to be a piecewise affine system, which is 
usually described by 



x + {t) = Aix{t) + bi, Qx(t)t.di 



(1-6) 



where A, , £>,- , C; , and dj are constant matrices or vectors of appropriate dimensions, 
respectively, and {x : C,x > dj) — y (i), i e M. When all bt's vanish, the system 
is known as a piecewise linear system. If, in addition, each y~ l (i) is a cone, then 
the system is a conewise linear system. 

It is clear that the stability properties of a piecewise affine system might not be 
consistent with that of the subsystems. One difficulty for stability analysis is to make 
clear the transition relationship among the polyhedral cells. As an example, consider 
the discrete-time planar four-form piecewise linear system given by 



x(t + l) = Ajx(t), x(t)eQi, i' = l, 
where J2, is the rth quadrant for i = 1, . . . , 4, and 



-0.5 -1 
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A 3 = 
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It can be seen that any (nonorigin) state in the first quadrant will enter into the 
third quadrant, then the fourth, then the second, and then the first once again. As 
a result, the discrete state is periodic with period 1, 3, 4, 2. While not all the sub- 
systems are stable, the transition matrix over a period, A2A4A3A1, is Schur stable. 
Therefore, the piecewise linear system is asymptotically stable. Figure 1.3 shows 
the motions of the discrete and continuous states. The continuous state converges to 
the origin very slowly. 



1.2.4 Stochastic Stabilities Under Random Switching 



A random switching signal is a time-driven switching signal that fluctuates irregu- 
larly but obeys a distribution stochastically. Even when all the subsystems are deter- 
ministic, a random switching signal makes the switched system random in nature, 
and the stability notions have to be defined in a stochastic manner. A well-known 
feasible set of random switching signals is the Markov jump where switches be- 
tween different subsystems are governed by a finite-state Markov process/chain. 
When the subsystems are linear and the switching is Markov jump, the switched 
system is known to be a (Markovian) jump linear system. 

The stability properties of jump linear systems are much involved as there exist 
several stochastic stability concepts that differ in conservativeness as well as ease 
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Fig. 1.3 Motions of discrete state (left) and continuous state (right) 



of testability. The most important stability notions are mean-square stability and 
almost sure stability. While the detailed definitions will be presented in Sect. 3.2, 
mean square stability is the asymptotic convergence to zero of the second moment 
of the state norm, and almost sure stability means that the sample trajectory of the 
state converges to zero with probability one. To exhibit the difference between the 
stabilities, examine the simple scalar two-form jump linear system where Ai = — 1 
and A2 — 0.5, and the switching signal is a Markov stochastic process with the 
stationary transition probability 

Pr(er(r + h) = j\a(t) = i)=h + o(h), i, j =1,2, i ^ j. 

The state solution can be expressed by 



x(t) = e 



A 1 t l +A 2 t 2 



x = e 



-I,+0.5t 2 



A-(). 



where t\ and t% are the lengths of durations over [0, t ] at the first and second sub- 
systems, respectively. Applying the law of large numbers, we have 



ti 



1 



lim — = lim 

t-t + OO t t^+OG t 2 



a.s. 
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It follows that 

lim \x(t)\ — a.s. 

On the other hand, it can be seen that 

2 



E{x 1 (t)} = Y,E{x 1 (tn\o(t)=i}}, 



l=\ 

where lj.) is the Dirac measure. Denote Z,(?) = E{x (f)\{ a (t)=i}}, i — 1, 2; simple 
calculation yields 

— Zi(r) = -3Zi(r) + Z 2 (r), 

— Z 2 (t) = Zi(t), 
at 

which is unstable. Therefore, the square moment is diverging with probability one, 
and the system is not mean square stable. 



1.2.5 Stabilizing Switching Design 

By Definition 1.2, a switched system is (asymptotically/exponentially) stabilizable 
if there is a feasible switching law that steers the system (asymptotically/expo- 
nentially) stable. Such a switching law is said to be a stabilizing switching law for 
the switched system. It is clear that, apart from formulating stabilizability criteria 
that characterize the existence of a stabilizing switching law, a more important issue 
is to explicitly calculate a stabilizing switching law. The latter is known to be the 
problem of stabilizing switching design. 

When the set of feasible switching signals is given by T as as defined in (1.4), the 
choice of a switching law is unconstrained, and the designer could take any switch- 
ing mechanism into account. Otherwise, the switching design is constrained. In par- 
ticular, if the switching law has to be initial-state-independent, i.e., 6 X — 9 y for all 
x and y, then the stabilizability is said to be consistent stabilizability; if the switch- 
ing law has to be time-independent, i.e., y — (p(s; 0, x, 6 X ) =>■ 6 y (t) = 9 x (s + t) 
Vr e 7o, then the stabilizability is said to be spatial stabilizability; and if the switch- 
ing law has to be with a preassigned dwell time, then the stabilizability is said to be 
dwell-time stabilizability. As a comparison among the stabilizabilities, we examine 
the planar two-form continuous-time switched linear system with subsystems 



2 
-1 



1 1 
-1 1 



12 1 Introduction 

While both subsystems are unstable, the switching law 

[l if xi (0 = 0, 

1 2 otherwise 

steers the switched system exponentially stable. Therefore, the switched system is 
spatially stabilizable. On the other hand, the system is not consistently stabilizable, 
due to the fact that the sum of the subsystem eigenvalues is greater than zero (cf. 
[216]). As for dwell-time stabilizability, it can be seen that, for any preassigned 
dwell time x, there is a stabilizing switching law that admits the dwell time. Indeed, 
this can be achieved by modifying the switching law to be 

o( t) J l *'^&, l( o = o, (18) 

2 otherwise. 

Note that the switching laws are not practically implementable due to the singular 
switching condition x\(i) — 0. This brings the problem of robust switching design, 
which will be addressed in Chap. 4. 



1.3 Organization of the Book 

The book contains five chapters. Besides this short Introduction, there are four major 
chapters, which are briefly summarized as follows. 

Chapter 2 focuses on stability analysis of switched dynamical systems un- 
der arbitrary switching. For general switched nonlinear systems, we establish the 
equivalence between marginal/asymptotic stability and the existence of a common 
weak/strong Lyapunov function. This reveals that the common Lyapunov approach 
is with full capacity in characterizing the guaranteed stability. For switched linear 
systems where the subsystems are linear, we further investigate the classes of func- 
tions that are universal for the stability. While quadratic functions are not universal 
as for stability of linear systems, we show that either piecewise linear/quadratic 
functions or norms are universal, which exhibit that the problem of stability is "con- 
vex" in nature. Furthermore, the well-known stability notions, such as attractivity, 
asymptotic stability, and exponential stability, are shown to be equivalent to each 
other. The equivalences, as in the linear stability theory, demonstrate that the stabil- 
ity is relatively simple in classification. Nevertheless, the verification of stability is 
by no means simple. Indeed, if we connect the absolute stability of a Lur'e system, 
which is notoriously difficult and still largely open though numerous achievements 
have been made during the past seventy years, with the guaranteed stability of the 
extreme switched linear system, then it can be seen that the former can be seen as a 
special case of the latter. For discrete-time switched linear systems, it has been made 
clear that the largest Lyapunov exponent is equal to the joint/generalized spectral ra- 
dius, and asymptotic stability implies that the spectral radius is less than one. While 
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the characteristic is insightful and elegant, the computation of the spectral radius is 
usually very hard. For this, we introduce a sum-of-squares technique approximating 
the spectral radius using high-order homogeneous polynomials as common Lya- 
punov functions. For a continuous-time system, we prove that asymptotic stability 
is equivalent to the negativeness of the least measure of the (subsystem) matrix set, 
which could be seen as a generalization of the largest real part of a single matrix. 
We also discuss the possibility of converting a switched system into a quasi-normal 
form by means of a common and possibly nonsquare coordinate transformation. 

In Chap. 3, we investigate stabilities of switched linear systems under constrained 
switching. In the first part, we focus on stochastic stabilities of jump linear systems. 
Several stability notions are introduced including moment stability, stochastic stabil- 
ity, and almost sure stability. It is revealed that mean square asymptotic/exponential 
stability is equivalent to stochastic stability, which amounts to the feasibility of a 
coupled Lyapunov equation. A verifiable sufficient and necessary condition is also 
presented for mean square stability. For almost sure exponential stability, a suffi- 
cient and necessary condition is the norm contractivity of the state transition matrix 
within a finite number of switches. Though intractable, this exhibits that almost sure 
stability could be seen as stability of the averaged system. 

In the second part of Chap. 3, we address the autonomous stability of piecewise 
affine systems. The piecewise quadratic Lyapunov approach, the surface Lyapunov 
approach, and the transition graph approach are introduced. The piecewise quadratic 
Lyapunov approach could provide less conservative exponential stability criteria at 
the cost of high computational burden. The surface Lyapunov approach, on the other 
hand, could reduce the computational burden by searching the Lyapunov functions 
over the switching surfaces instead of the total state space. It yields tractable asymp- 
totic stability criteria for continuous-time piecewise linear systems with three or 
less switching surfaces. The transition graph approach provides an effective method 
for attractivity analysis with the aid of graphic decomposition, which is applicable 
to both discrete-time and continuous-time systems. We also address stabilities of 
conewise linear systems and present a constructive procedure for stability verifica- 
tion. 

The third part of Chap. 3 is devoted to dwell-time stability and stabilizability. 
We show that dwell-time stability implies the existence of a dwell-time Lyapunov 
function. With the help of the sum-of-squares technique, we present a homogeneous 
polynomial Lyapunov function approach for calculating an upper bound of the least 
stable dwell time. For dwell-time stabilizability, the concept of 6 -robust dwell time 
is introduced to keep a balance between the quality of the switching signal and the 
performance of the continuous state. A new combined switching strategy is also 
developed to further enlarge the dwell time without deteriorating the system perfor- 
mance. 

The object of Chap. 4 is to develop a design scheme for the problem of stabiliza- 
tion by means of switching. We establish that a switched nonlinear system is asymp- 
totically stabilizable iff it admits a smooth Lyapunov function. However, even for 
a planar switched linear system, a convex Lyapunov function does not necessarily 
exist. For this, the set of composite quadratic Lyapunov functions is examined from 
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the viewpoint of optimal switching with quadratic cost indices, and we prove that 
the function set is universal in the sense that each asymptotically stabilizable system 
admits a Lyapunov function in the set. To further address the stabilization problem 
in a constructive manner, we propose a new switching mechanism named pathwise 
state-feedback switching, which concatenates a set of pre-assigned switching paths 
in a state-feedback way. We develop a computational procedure for calculating a 
stabilizing path-wise state-feedback switching law for an asymptotically stabilizable 
switched linear system. To address the robustness of the switching law, we define 
a (relative) distance between two switching signals and prove that the closed-loop 
system is robust against structural/unstructural/s witching perturbations. 

The last chapter, Chap. 5, provides a broader view of switched dynamical systems 
by connecting them with several well-known schemes in the system and control lit- 
erature. First, for a planar two-form switched linear system, a phase-plane-based 
stability criterion is derived, and it is applied to the absolute stability of planar Lur'e 
systems. Second, we introduce a supervisory switching scheme for adaptive control 
of linear processes with large-scale parameter uncertainties. The scheme consists 
of a multicontroller, a multiestimator, a monitoring signal generator, and a switch- 
ing logic. When properly designed, all the signals in the closed-loop system are 
bounded, while the output is asymptotically convergent. Third, we conduct stability 
analysis for Takagi-Sugeno (T-S) fuzzy systems. To this end, we introduce a frame- 
work of piecewise switched linear systems that combine and extend both piecewise 
affine systems and switched linear systems. A stability criterion for the system is 
presented with the help of the piecewise quadratic Lyapunov method. By aggregat- 
ing a T-S fuzzy system into a piecewise switched linear system, a stability crite- 
rion is ready to obtain. Fourth, we examine the problem of consensus for a class 
of multiagent systems with proximity graphs and linear control protocols. We show 
that the problem is in fact a special stability problem for a piecewise linear system, 
which could be addressed by means of graph transition analysis. Finally, for control- 
lable switched linear systems, a multilinear feedback design approach is proposed 
to tackle the stabilization problem. The main idea is to associate a set of candidate 
linear controllers with each subsystem so that the extended switched system is sta- 
bilizable. By utilizing the path-wise state-feedback switching design diagram, the 
problem of stabilization is solved in a constructive manner. 



1.4 Notes and References 

Switching is a phenomenon that widely exists in many real-world processes where 
logic elements interact with continuous dynamics. The study of switched dynamical 
systems takes root in modeling, control, and optimization for complex dynamical 
systems. First, switched dynamical systems could represent or approximately repre- 
sent many practical systems, such as power electronics, gene networks, and intelli- 
gent softwares, to list a few. Second, switching control is a powerful design method- 
ology widely used in dealing with highly complex systems including automotive 
control, flight control, and networked control. Third, even for systems which could 
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be addressed by conventional methods/tools, the switching scheme provides an al- 
ternative diagram that could achieve the optimization in a better manner. Fourth, 
switched dynamical systems form a framework that extends both the conventional 
nonlinear (continuous) systems and discrete event systems. Therefore, it is an inte- 
gration of the two types of dynamical systems. 

The study of switched systems could be traced back to the 1960s when a series 
of works were devoted to optimality of switched system with either stochastic or 
autonomous switching [68, 240, 241, 262]. In the 1990s, a more general scheme 
of hybrid systems received increasing attention from both the control and computer 
communities. While a commonly acceptable definition of a hybrid system is still 
missing, it has been widely recognized that interaction between continuous dynam- 
ics and discrete dynamics is an important feature of a hybrid system. As a simple yet 
typical hybrid system, a switched system gradually became a major focus that has 
been attracting many researchers' interest. Since then, remarkable progress has been 
made in problems ranging from controllability/observability [49, 55, 67, 98, 105, 
122, 236, 266] to stability/stabilizability [54, 60, 88, 104, 142, 147, 159, 164, 232, 
259, 281] and optimality [20, 24, 123, 141, 200, 201, 220, 270, 279]. Meanwhile, 
some new problems that are unique to switched systems emerged, for instance, the 
problem of slow switching [66, 219, 227, 261, 263], the problem of robustness w.r.t. 
switching perturbations [225, 235], and the problem of bumpless transfer switching 
[86], to list a few. These problems are closely related to the issue of high-quality 
switching, which is a key in achieving good performance by means of switching. 

For application-oriented switching control and design, the reader is referred to 
[2, 52, 65, 97, 155, 186, 209, 246, 283] for a short list. For more systematic reviews 
of recent development on switched systems, the reader is referred to the monographs 
[145, 146, 180, 234] and the survey papers [91, 151, 161, 208, 233, 245]. 



Chapter 2 
Arbitrary Switching 



2.1 Preliminaries 

For switched dynamical systems, the switching may be induced by unpredictable 
change of system dynamics, such as a sudden change of system structure due to the 
failure of a component. In these cases, in order to keep the system working, it is 
necessary for the system to be stable under arbitrary switching. That is to say, the 
system should be stable under any possible switching law. Therefore, the stability 
is absolute or guaranteed regardless of the switching law. As the term "absolute 
stability" has been used to describe the global asymptotic stability for Lur'e systems 
with sector-bounded nonlinearities, here we use the term "guaranteed stability" to 
describe the stability of switched systems under arbitrary switching. 
In this chapter, we consider the switched dynamical system given by 

* + (0 = /(*(0,ff(0), (2.1) 

def 

where x(t) e R" is the continuous state, a(t) e M — {1, . . . , m) is the discrete state, 
and /: R" xMh>R" isa vector field with /(■, i) Lipschitz continuous for any 
( eM. 

It is clear that system (2.1) includes both continuous evolution and discrete ele- 
ments. To emphasize the hybrid nature of the system, let us define new vector fields 
fi : R n h> R" by 

fi(x) = f(x,i), ieM. 

Then, the system can be rewritten as 

x + (t) = f a(t) {x(t)). (2.2) 

The issue of this chapter is the guaranteed stability analysis of switched dynam- 
ical system (2.2). For this, we assume that 
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(1) /, (0) = for all i e M, which implies that the origin is an equilibrium. 

(2) The system is globally Lipschitz continuous, that is, there exists a positive con- 
stant L such that 

\fi(x) - fi(y)\ < L\x - y\ Vx, y e R", i e M, (2.3) 

which guarantees the well-definedness of the switched system. 

For clarity, we denote by <p(t; to, xo, a) the continuous state motion of system 
(2.2) at time t with initial condition x(fo) — xo and switching path a . By abuse 
of notation, we also use <j>(t; xo, a) to denote the solution when to — 0. The state 
evolution can be explicitly expressed in terms of the vector fields /,-, i e M. Indeed, 
for any initial condition x(to) — xo and time t > to, in discrete time we have 

(j>(t; to, xo,(T)= /ff(f-i) o ■ • • o fcffy+i) o fa(t )(xo), (2.4) 

def 

where o denotes the composition of functions, that is, /i o f%(x) — /i(/2W). For 
continuous-time switched systems, the state evolution is 

4>(f; to, xo, a) = <p{\ o cp^ o ■ ■ • o <P f Ji f] o <p!;\(x q ), (2.5) 

f 
where <P t (xo) denotes the value at t of the integral curve of / passing through 

x(0) = xo, and (to, io), ■ ■■ , (t s , is) i s the switching sequence of a in [to, t). How- 
ever, as the analytic expression of the curve <P t (xo) is not available in general, the 
expression in (2.5) does not provide a sound basis for further analysis. 

To present stability definitions for switched systems, we need more notation. Let 
d(x, y) denote the Euclidean distance between vectors x and y. For a set £2 C R" 
and a vector x e R", let \x\n — infygj? d(x, y), and the normal norm |x|(oj is de- 
noted by |x| in short. For a set Q C R" and a positive real number r, let B(£2, r) be 
the x -neighborhood of Q , that is, 

B(fi,r) = {xeR": \x\ n <r). 

Similarly, let H(i2, x) be the r-sphere of Q, that is, 

H(,Q,r) = {xeR": \ x \ a =x\. 

In particular, the closed ball B({0}, r) will be denoted by B T in short, and the sphere 
H({0},T)byH T inshort. 

Definition 2.1 The origin equilibrium for system (2.2) is said to be 
(1) guaranteed globally attractive if 

lim \d>(t;x,a)\=Q VieR", ae5 

«-s-+oo' ' 
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(2) guaranteed globally uniformly attractive if for any S > and e > 0, there exists 
T > such that 

\4>(t;x,o)\<e Vt eT T , \x\<8, a eS 

(3) guaranteed stable if for any e > and a e S, there exists 5 > such that 

\<t>(t\x,c)\ <€ Vf e%, \x\ <S 

(4) guaranteed uniformly stable if there exist S > and a class /C function y such 
that 

|(/)(f;x,CT)| <y(|x|) Vte%, \x\ <S, aeS 

(5) guaranteed globally asymptotically stable if it is both guaranteed stable and 
guaranteed globally attractive 

(6) guaranteed globally uniformly asymptotically stable if it is both guaranteed uni- 
formly stable and guaranteed globally uniformly attractive 

(7) guaranteed globally exponentially stable if for any a € S, there exist a > and 
fi > such that 

\4>(f,x,a)\ <Pe-°"\x\ WeT , isR" 

and 

(8) guaranteed globally uniformly exponentially stable if there exist a > and 
P > such that 

\<p(t;x,o)\ <Pe~°"\x\ VteT Q ,xeR n ,(reS 

Note that the uniformity is referred to the switching signals rather than the initial 
time. By abuse of notation, we say that the system is guaranteed stable/attractive if 
the origin equilibrium is guaranteed stable/attractive. As we focus on the guaran- 
teed stabilities with possible global attractivity in this chapter, the restrictive words 
"guaranteed" and "global" will be dropped for short in the sequel. Note also that 
the uniform asymptotic/exponential stability is consistent with that defined in Defi- 
nition 1.1. 



2.2 Switched Nonlinear Systems 

In this section, we investigate the stability issue for switched nonlinear system 

* + (0 = /a(0(*(0) ( 2 - 6 ) 

under arbitrary switching. We assume that each vector field /; is continuously dif- 
ferentiable. 
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2.2.1 Common Lyapunov Functions 

The direct Lyapunov method provides a rigorous approach for studying stability of 
dynamical systems. Here, we review the preliminaries of Lyapunov stability theory. 
A continuous function V(x) : R" h+ R with V(0) = is: 

• positive definite (V(x) > 0) if V(x) > Vx e R" - {0} 

• positive semi-definite (V(x) >; 0) if V(x) > Vx e R" 

• radially unbounded if there exists a class /Coo function a(-) such that V(x) > 
a(|x|)VxeR" 

Definition 2.2 Let 12 bea neighborhood of the origin. A function V : 12 h^ R is 
said to be a common weak Lyapunov function (CWLF) for switched system (2.6) 
if 

(1) it is lower semi-continuous in Q 

(2) it admits class K. bounds, that is, there are class K, functions ai and »2 such that 

<xi(\x\)<V(x)<a 2 (\x\) WxeQ 

and 

(3) the upper Dini derivative of V along each vector /; is nonpositive; that is, for 
all x e 12 and i e M, we have 

rfivt m def r V(0(r;O,x,Q)-y(x) ^ A 
£> T V(x)|/;. = hmsup <0 

in continuous time, where i stands for the constant switching signal a (t) — i Vf , 
and 



D + V(x)\ ft =V(Mx))-V(x)<0 



in discrete time 



Remark 2.3 Note that we do not require that the common weak Lyapunov func- 
tion is continuous. As a matter of fact, even a uniformly stable nonlinear system 
x = f(x) with / being sufficiently smooth may not admit any continuous weak 
Lyapunov function [14]. 

Definition 2.4 A function V : R" m* R is said to be a common (strong) Lyapunov 
function (CLF) for switched system (2.6) if 

(1) it is continuous everywhere and continuously differentiable except possibly at 
the origin 

(2) it admits class ICoo bounds, that is, there are class /Coo functions a\ and a 2 such 
that 

ai(W)<V(jt)<a 2 (W) VxeR", 
and 
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(3) there is a class K, function »3 : R" i->- R + such that 

V + V(x)\ fi <-a 3 (\x\) VxeR", ieM (2.7) 

Remark 2.5 In continuous time, it can be seen that 

, V(x + Mx)t)-V(x) 
T>+V(x)\ f , = lim sup — — VieR", ieM, (2.8) 

due to the local Lipschitz continuity of V. For a continuously differentiable func- 
tion V, its Dini derivative coincides with the (Lie) derivative of V along the vector 
field 

V + V(x)\ f = C !-V(x) = L f V(x) = ^ r V(x)f{x). 
dt dx 

Suppose that system (2.6) admits a common weak Lyapunov function V . Then 
for any state trajectory x(t) — (p(t; xq, a) in £2, we have V(x(t)) < V(xo) for all 
t > 0. For any e > 0, choose S such that 

BsCti, {x: V(x)<8} CB 6 . 

Then, we have \x(t)\ < e for all t > if xo G B^. This shows that the system is 
uniformly stable. 

Next, suppose that system (2.6) admits a common Lyapunov function V . We 
are to show that the system is uniformly asymptotically stable. For this, we assume 
that the system is in continuous time, and the discrete-time case can be treated in a 
similar way. Fix an initial state xq ^ and a switching signal a , and denote x(t) = 
x(t; xo, a). It follows from Definition 2.4 that 

V(x(t + t))-V(x) („f ,.\\ w . T 

hmsup < -a A {V{x(t))) Vf e %, (2.9) 

where a^ = a^oa^ ■ Define the function r\ : R + \-^- R by 

- f! ■ , 1 . » dx, re (0,1), 



ri(t) = 



■ f! —\—,dx, t > 1. 



It is clear that r\ is strictly decreasing, differentiable, and lim r ^o'7(0 = +oo. 
From (2.9) it can be seen that 

r)(V(x(t)))-r)(V(xo))= [ f,(V(x(t)))dV(x(s)) 

Jo 

> I \ds = t Vf>0. (2.10) 

Jo 
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Define the function it : R + x R + \-> R + by 

n(s,t) = 




which can be verified to be a /C£-function. As n is strictly decreasing, it follows 
from (2.10) that 

V(x(t))<7t(V(x ),t) Vr>0. 

Define the other AC£-function /J by 

P(s,t) = a~[ l (7r(a2(s),t)), s, t e R+. 

It can be seen that 

|*(O|<0(|*ol,O Vf ^°- (2- 11 ) 

This, together with the fact that the origin is an equilibrium of the switched sys- 



tem, implies that the system is uniformly asymptotically stable. Indeed, to achieve 

uniform stability, for any e > 0, let 8 — /3 _1 (e), where /J(-) = /3(-,0). Then, 
\4>{t; 0, x, a)\ < e for any xq e Us, t e %, and a e S. Similarly, to achieve uni- 
form attractivity, for any e > and S > 0, let T — J3~ (e) where /i(-) = P(8, •); 
then \4>(t; 0, x, <r)| < e for any xo £ Bg, f e 7r, and cr e 5. 
To summarize, we have the following proposition. 

Proposition 2.6 Switched system (2.6) is uniformly stable if it admits a common 
weak Lyapunov function, and it is uniformly asymptotically stable if it admits a 
common Lyapunov function. 

Example 2. 7 For the planar continuous-time two-form switched system with 
-rX(t) = f a {x(t)), 

* W = (*-%)• *™ = (- "-I*)' (2 " 12) 

where k is any odd natural number, it can be verified that V(x\, xj) — x^ + x\ is 
a common weak Lyapunov function. By Proposition 2.6, the system is uniformly 
stable. However, the system does not admit any common Lyapunov function. In- 
deed, if the system admits a common Lyapunov function, then it follows that any 
convex combination system of the subsystems is asymptotically stable, that is, the 
dynamical system 

*(0 = »/i(*(0) + (l -©)£(* w) 

is asymptotically stable for any u> e [0, 1]. Let co — \. It can be verified that any 
state on the xj-axis is an equilibrium. As a result, the convex combination system is 
not asymptotically stable. The contradiction exhibits that the switched system does 
not admit any common Lyapunov function. 
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2.2.2 Converse Lyapunov Theorem 

While the existence of a common weak/strong Lyapunov function guarantees the 
uniform/asymptotic stability of the switched system, one may naturally ask whether 
the converse is also true. The answer is confirmative, as shown in the following 
proposition. 

Proposition 2.8 Any uniformly stable switched system admits a common weak Lya- 
punov function, and any uniformly asymptotically stable switched system admits a 
common Lyapunov function. 

Proof To prove the first half of the statement, suppose that the system is uniformly 
stable. Fix an e > 0, and let S > be the number as in Definition 2.1. As in the 
standard Lyapunov method, define the function V : Bg !-► R+ by 

V(x)= sup \(j)(t;0,x,a)\. (2.13) 

teT ,oeS 

It is clear that the function is well defined and positive definite in B^. Let Q — B£, 
where D° denotes the interior of set D. We are to prove that V is a common weak 
Lyapunov function for the system. 

To prove the lower semi-continuity of function V, fix an x e Bg. For any e > 0, 
there exist a time t x > and a x e S such that 

\(p(t x ; 0,x,a x )\ > V(x) - e. 

Let r\ — e L in continuous time and n — Lin discrete time. It follows from the Lips- 
chitz assumption (2.3) that 

V(y)> \<p(t x ',0,y,a x )\ > \<j>(t x ;0,x,a x )\ - \<p(t x ;0,y,a x )-tf>(t x ;0,x,a x )\ 

> \<p(t x ;0,x,o x )\ -n h \x-y\> V(x)-2s Vy eBLx, -|- J nB g . 

As a result, V is lower semi-continuous. 

Next, for any ieBj,ieTo, and i e M, we have 

V(4>(js;0,x,i))= sup \</>(t;0,<j)(s;0,x,i),a)\< sup \(p(t + s;0,x,a)\ 

< sup \(/>(t + s;0,x,a)\ — V(x). 
(t+s)eT ,aeS 

It follows that V + V(x)\ fi < for any ieM. 

Finally, it is clear that V(x) > [jc | for any x e Bg, and hence it admits a class K, 
lower bound. On the other hand, the uniform stability means the existence of a class 
JC function ai such that \4>(t; 0,x, a)\ < a2(\x\) for any t e 7o, x e Bg, and a eS. 
As a result, V(x) < a2(kl) for all x e B^. 
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The above reasonale shows that the function V defined in (2.13) is indeed a 
common weak Lyapunov function for the switched system. 

The proof of the second half of Proposition 2.8 is involved as we have to smooth 
the above function while preserving its properties such as decreasing along the state 
trajectories. We will not go into the details; instead we cite the following support 
lemma, which is a simper version of the well-known Lin-Sontag-Wang converse 
Lyapunov theorem [152]. 

Lemma 2.9 For the uncertain system 

x + (t) = f(x(t),d(t)), x(t)eR n , d(t)eVcR p , (2.14) 

suppose that f is locally Lipschitz continuous in x uniformly in d, T> is a compact 
set, and d e PC(Tq, T>), the set of piecewise continuous functions mapping from Tq 
to T>. Assume that the system is forward complete and the compact subset X ofW is 
a forward invariant set in the sense that x(t) e X for all xq e X and d G PC(Tq, T>). 
If there is a ICC function /3 such that 

\x{i)\ x <p{\xo\ x ,t) Wx Q eR"-X, t >0, dePC(T ,V), (2.15) 

then, there is a Lyapunov function V for system (2.14), i.e., V is continuous every- 
where and infinitely differentiable on R" — X , and there are /Cqo functions a\,a^ 
and a class K, function a^ such that 

<xi(\x\x)<V(x)<a 2 (\x\ x ) 

and 

LfV(x) < -a 3 {\x\ x ) Vx eR", de V. 

The lemma provides a general converse Lyapunov theorem, which is very impor- 
tant in the development of the stability and robust analysis and design. The proof of 
the lemma is quite technically involved, and the reader is referred to [124, 152] for 
details. 

With the help of Lemma 2.9, the proof for the necessity of Proposition 2.8 is 
quite straightforward. Indeed, in Lemma 2.9, letT>—M and X — {0}. Then, Propo- 
sition 2.8 follows immediately from the lemma due to the fact that asymptotic sta- 
bility implies (2.15). □ 

To summarize, in terms of the relationship between the uniform stability and the 
existence of a common Lyapunov function, the following conclusion can be drawn. 

Theorem 2.10 Switched system (2.6) is uniformly stable iff it admits a common 
weak Lyapunov function, and it is uniformly asymptotically stable iff it admits a 
common Lyapunov function. 
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The theorem clearly brings the stability verification to the search of an appro- 
priate common (weak) Lyapunov function and extends the conventional Lyapunov 
theory to the more general setting of switched systems. As in the conventional Lya- 
punov theory, there is generally no systematic way of finding the Lyapunov func- 
tions. Nevertheless, for some classes of systems with special structures or properties, 
the search of a Lyapunov function is tractable. We will come back to this topic in 
Sect. 2.3.5. 



2.3 Switched Linear Systems 

In this section, we focus on a special but very important class of switched systems 
where all the subsystems are linear time-invariant. These systems are termed as 
switched linear systems and are mathematically represented by 

x + (t) — A o(t) x(t), x(0)—x Q , (2-16) 

where At e R" x ", k e M, are constant matrices. 

Let A = {A\, . . . , A m }. A can be seen as the system matrix set for the switched 
linear system. For briefness, we term the switched linear system as system A. 

Due to the linear nature of the subsystems, the state solution can be given in an 
analytic way. In fact, the solution is given by 

(p(f,to,xo,cT) = ®(f,to,(T)xo, (2.17) 

where &{t; to, a) is known to be the state transition matrix. In discrete time, the 
state transition matrix is 

&(t;t Q ,cT) = A a(t - l yA a(to) , 

while in continuous time, it is 

<P( t . tQ(J ) _ e A, s (.t-t s ) e A lsl (t s -t s -i) _ , tg A I - 1 te-H) e Aj (l 1 -/b) ) 

where to,t\, ...,t s and io,h,...,i s are the switching time/index sequences in 
[to, t), respectively. 

It follows from the above expressions that 

4>{t;to,Xxo,a) =X(j)(t;to,xo,(T) Vf , to, xq, a, VA. e R, (2.18) 

which we term as the radial linearity property, and 

4>{t;to,xo,a) — (j)(t -to\0,xo,a') Vt,to,xo,a, (2.19) 

where the switching path a' is the time transition of a , that is, a'(t) — a(t + to) for 
all t. The latter property is known as the (time) transition invariance property. 

Due to the above two invariance properties, for switched linear systems, it is clear 
that local attractivity implies (and is equivalent to) global attractivity, and the initial 
time can always be taken as to — without loss of generality. 
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2.3.1 Relaxed System Frameworks 

In the stability analysis of switched linear systems, the switching signals can be ar- 
bitrary. Taking the switching mechanism as the uncertainty, the guaranteed stability 
requires that the system is robust w.r.t. the uncertainty. As the switching signals are 
piecewise constant taking values from a finite discrete set, it is natural to "smooth" 
them in some sense so that the conventional perturbation analysis approaches apply. 
This leads to the relaxed or extended system frameworks as follows. 
Let 



W = | w e R m : wi ■ > 0, i = l,...,m, ^ w, < 1 1 

111 

A(w) = Y] wAi, weW, (2.20) 

i=i 

and 

A(x) = {A(w)x:weW}, x e~R" . (2.21) 

Let us consider the (convex) differential/difference inclusion system 

x + (t)eA(x(t)), (2.22) 

and the polytopic linear uncertain system 

x + (t) = A(w(t))x(t), (2.23) 

where w(-) e W is a piecewise continuous function. For convenience, system (2.22) 
is called (relaxed) differential/difference inclusion. Note that both the differen- 
tial/difference inclusion and the polytopic linear uncertain system can be connected 
to the switched system in a one-to-one manner, and the switched system can be seen 
as the extreme system of the others. 

A solution of (2.22) is a vector flow x : [0, +oo) i-> R" with absolutely continu- 
ous entries that satisfies (2.22) almost everywhere. Solutions of the polytopic system 
can be understood in the same way. 

For comparison, let r s denote the set of solutions of the switched linear system, 
r p the set of solutions of the polytopic system, and r c i the set of solutions of the 
differential inclusion system. It is readily seen that 

r s cr p c r d 

and the first subset relationship is strict. However, under mild assumptions, each 
solution of the relaxed differential inclusion system can be approximated by a tra- 
jectory of the switched linear system in the sense specified below. 
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Lemma 2.11 (See [117]) Fix £ G R" aw/ /e/ z : [0, +oo) i-> R" be a solution of 

z(t)eA{z{tj), z(0) = f. 

Lef r: [0, +oo) i-v R Z?e a continuous function satisfying r(t) > for all f > 0. 
77ze«, f/zere exist rj with \ n — § | < r (0) aw<i a solution x : [0, +oo) I— >• R" of 

x{t) e \Aix(t), ..., A m x(t)}, x(Q) = rj, 

such that 

\z(t)-x(t)\<r(t) Vre[0, +oo). 

This lemma sets up a connection between stability of a switched linear system 
and stability of its relaxed system. Indeed, suppose that each solution of the switched 
linear system is convergent; then, each solution of the differential inclusion (2.22) 
is also convergent. For discrete-time systems, the relationship also holds. 

Corollary 2.12 The following statements are equivalent: 

(1) The switched linear system is attractive. 

(2) The polytopic linear uncertain system is attractive. 

(3) The differential inclusion system is attractive. 

For linear systems, it is well known that attractivity implies (and is equivalent 
to) exponential stability. For switched linear systems, it can be proven that the same 
property also holds as follows. 

Proposition 2.13 The following statements are equivalent: 

(1) The switched linear system is attractive. 

(2) The switched linear system is uniformly attractive. 

(3) The switched linear system is asymptotically stable. 

(4) The switched linear system is uniformly asymptotically stable. 

(5) The switched linear system is exponentially stable. 

(6) The switched linear system is uniformly exponentially stable. 

Proof First, it is clear that the uniform exponential stability implies any other stabil- 
ity in the proposition, and attractivity is implied by any other stability. As a result, 
we only need to prove that the attractivity implies the uniform exponential stability. 
Second, for any state x on the unit sphere, it follows from the attractivity that 
there is a time t x such that 

sup|</)(r v ;0,x,CT)| < -. (2.24) 

aeS 2 

For any fixed x e Hi, we are to prove that sup^g^ \<t>(t x ; 0, y, a)\ < j if y is suf- 
ficiently close to x. Indeed, let n — max, e M |A;|. It follows from (2.24) and (2.17) 
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that 

\(t>(t x ;0,y,(j)\ = \4>(t x ;0,x,a)+4>(t x ;0,y-X,a)\ 

< \4>(t x ; 0, x,a)\ + \4>(t x ; 0,x-y,a)\ 

< \<j)(t x ;Q,x,o)\+e 1 i' X \y-x\ 

<- VaeS, \y-x\<e~ , " x (--sup\(t>(t x ;0,x,a) 
2 V 2 o-eS 

This implies that, for any x e Hi, there is a neighborhood N x of x such that 

svLp\<j>(t x ;0,y,a)\< \ VyeN x . 
aeS l 

Third, letting x vary along the unit sphere, it is obvious that 

As the unit sphere is a compact set, by the Finite Covering Theorem, there exist a 
finite number / and a set of states x\ , . . . , x; on the unit sphere such that 



U^^Ht. 



i=\ 



Accordingly, we can partition the unit sphere into / regions R\, ..,, Ri such that 

(a) ULi R i = H l> and R i n R j = for ' ^ J> and 

(b) for each i , 1 < i < /, X[ € Ri , and 



sup|0(^;O,y,<r)|<-, VyeRi. 

aeS l 

Define the cones 

Qi ={ieR": 3A ^ and y e R { such that x = Xy], i = l,...,l. 

Let £? = {0}. It can be seen that |j'. =0 Q t — R" and Q t HQj —0 for i ^ j. In par- 
ticular, £2q is invariant under arbitrary switching and forms an invariant equilibrium 
of the system. 

Fourth, for any i — I, . . . ,1 and x e Q\ • , let t x = t x ' . It is clear that 

/ \ f 

maxt x — maxt x ' = T\ < +oo. ( 2 - 2 5) 

According to properties (a) and (b), for any x e Qt, i — 1, . . . , /, any switching 
signal a will bring x into the ball B w at time t x . 

2 
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Finally, for any initial state xo and switching path a , define recursively a se- 
quence of times and states 
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A: = 0,1,..., (2.26) 



xo\, k = 0, 1,2, ..., 

where y — y^- On the other hand, let ?? = 2exp(7i max{|| Ai ||, . . . , || A m ||}). Then, 
we have 

|</>(r;0,x ,cr)| <^ _,/ '|xo| Vf>0. (2.27) 

Note that the inequality holds for any xo and a , and the parameters y and rj are inde- 
pendent of xo and a . This clearly shows that the system is uniformly exponentially 
stable. The proof is completed. □ 

Remark 2.14 While the theorem establishes a nice property for switched linear sys- 
tems, the proof itself does not provide a constructive approach for calculating or 
estimating the convergence rate. For special classes of switched linear systems with 
additional structure information, however, it is possible to compute the convergence 
rates explicitly. This issue will be addressed in Sect. 2.3.5. 

Simple observation exhibits that the above analysis can be slightly adopted 
to prove the equivalence (between attractivity and exponential stability) for the 
polytopic system and the differential inclusion system, respectively. Together with 
Corollary 2.12 and Theorem 2.10, we reach the following conclusion. 

Theorem 2.15 The following statements are equivalent for the switched linear sys- 
tem, the polytopic system, and the differential/difference inclusion system, respec- 
tively: 

(1) The system is attractive. 

(2) The system is asymptotically stable. 

(3) The system is exponentially stable. 

(4) The switched system admits a common Lyapunov function. 
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Remark 2.16 The theorem bridges the stability analysis for various classes of sys- 
tems with different backgrounds. Indeed, the stability analysis for polytopic sys- 
tems, for linear differential inclusions, and for switched linear systems is mostly 
independent of each other until quite recently. The theorem assures that the stabil- 
ity criteria developed for one class of systems are also applied to the others. This 
greatly enriches the stability theory for the systems. 

Theorem 2.15 allows us to define the stabilities in a more refined manner, as in 
the linear time-invariant case. For this, define 

q(A)= Urn sup Iy - , (2.28) 

r->+oo,cr£iS,|jt| = l * 

which is the largest Lyapunov exponent that specifies the highest possible rate of 
state divergence, and 

R(A) = {<Kt; 0,x,a): te%, *eHi, aeS}, (2.29) 

which is the attainability set of the system from the unit sphere. 

Definition 2.17 A switched linear system A is said to be 

(1) (exponential) stable if q(A) < 

(2) marginally stable if q(A) — and the set R(A) is bounded 

(3) marginally unstable if q(A) — and the set R(A) is unbounded 

(4) (exponentially) unstable if q (A) > 

It is clear that the notion of stability here is abused with the one defined for the 
nonlinear setting as it is referred to the situation of exponential convergence only. 
Similarly, the notion of instability is referred to exponential divergence only. In the 
sequel, unless otherwise stated, all the stability notions are referred in accordance 
with Definition 2.17. 



2.3.2 Universal Lyapunov Functions 

Through this subsection we assume, unless otherwise stated, that the switched lin- 
ear system is stable. According to Theorem 2.10, the system admits a common Lya- 
punov function that is smooth (C 1 ). As a result, the set of smooth positive definite 
functions is universal for switched linear systems. Here by universal Lyapunov func- 
tions we mean a set of functions such that each stable switched linear system admits 
a common Lyapunov function which belongs to the set. Due to the linear structure 
of the subsystems, it seems reasonable to expect a more restricted set of universal 
Lyapunov functions, e.g., the set of polynomials. In particular, as a stable linear 
time-invariant system always admits a quadratic Lyapunov function, it is natural to 
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conjecture that the set of quadratic functions is also universal for switched linear 
systems. If so, then it is possible to develop a constructive approach for calculating 
a common quadratic Lyapunov function. Unfortunately, this conjecture finally was 
disproved through a counterexample, which exhibits that the stability analysis of 
switched linear systems is much more difficult than that of linear systems. 

There are quite a few efforts in the literature to reveal the universal sets of com- 
mon Lyapunov functions for switched linear systems or, equivalently, for polytopic 
systems or linear convex differential inclusions. Due to the nonsmooth nature of 
switched system, nonsmooth functions are also considered as Lyapunov function 
candidates. 

The following theorem provides several sets of universal common Lyapunov 
functions for switched linear systems. 

Theorem 2.18 Each of the following function sets provides universal Lyapunov 
functions for stable switched linear systems. 

(1) Convex and homogeneous functions of degree 2. 

(2) Polynomials. 

(3) Piecewise linear functions. 

(4) Piecewise quadratic functions. 

(5) Norms, that is, positive definite functions N: R" H>- R+ such that N(Xx) — 
\X\N (x) for any X € Rand N(x + y) < N(x) + N (y) for any x , y e R". 

The key ideas of proving the existence of universal Lyapunov functions are 
outlined as follows. First, as in the conventional Lyapunov approach, for a stable 
switched linear system, we define the function V : R" i-> R+ by 

r+oo 
V(x)=sup/ \<p(t;0,x,a)\ dt (2.30) 

in continuous time and 



V(x)= sup^|</>(f;0,x,CT)| (2.31) 



cts5 r=0 



in discrete time. It can be verified that the function is continuous, positive definite, 
strictly convex, and homogeneous of degree 2. In addition, for any nontrivial state 
trajectory v(-) of the switched system, we have 

r+oo 
V(y(t 2 )) = sup / \<j>(t; 0,y (t 2 ),cr)\ z dt 

aeSJO 

f + °° 2 

= sup / \<p(t + t2-h;0,y(ti),a)\ dt 

aesJo 

f + °° 2 

— sup / \<p(t; 0,y(ti),a)\ dt 

aeS Jt2-t\ 
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+00 

0,y(.ti),a)rdt 



p+QO 

< sup / \<p(t; 

aeSJO 
= V(y(h)) Wt 2 >h, 

which clearly exhibits that the function V is strictly decreasing along the trajectory. 
Note that the function is continuous but may be nondifferentiable. The next step is 
to smooth the function by introducing the integral 

V(x)= J f(R)V(Rx)dR, xeR n , 



-/ 

JSO(n) 



where SOin) is the set of n x n orthogonal matrices with positive determinants, 
/ : SO(n) i-> R + is a smooth function with support in a small neighborhood of the 
identity matrix, and f so(n) f(R) dR — 1. It can be shown that the function V is con- 
tinuously differentiable (C 1 ) except possibly at the origin. A smooth function of C k 
with any k can be obtained iteratively in the same manner. The newly defined func- 
tion preserves the properties of convexity and homogeneity of degree 2. Moreover, 
the function strictly decreases along any nontrivial state trajectory of the switched 
system. By definition, the function is a common Lyapunov function of the system, 
and Item (1) of the theorem is established. The existence of other classes of univer- 
sal Lyapunov functions can be guaranteed by the fact that a convex level set can be 
approximated to any degree by the level sets of polynomials, piecewise linear func- 
tions, and piecewise quadratic functions, respectively. We omit the technical details 
for briefness. 

By the first statement of the theorem, there exists a common Lyapunov function 
of the form 

V(x)=x T P(x)x withP(;U)=P(x)>0 VA ^ 0, x ^ 0. 

Note that this function is in the quadratic form, and positive definite matrix P(x) 
is homogeneous of degree zero; hence it is uniquely characterized by its image on 
the unit sphere. A special case is that P(x) is independent of the state, which cor- 
responds to a quadratic Lyapunov function. When this is the case, the search of an 
appropriate Lyapunov function can be reduced to solving the linear matrix inequal- 
ities (LMIs) 

Aj P + PAj<0, i = l,...,m, (2.32) 

which is computationally tractable. 

A piecewise linear function is of the form 

V(x) — max{/ ( - x: i = 1, ...,s], 

where /, 's are column vectors in R" . It is convex and positively homogeneous of 
degree 1 . Its level set 

r={x: ljx< 1, i = l,...,s] 
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is a convex and compact set containing the origin as an interior point. We call such 
a set C-set. The level set r is also a polyhedron, and it induces the gauge function, 
known as the Minkowski function of T, which is defined as 

MF r (x) = inf{/LteR + : x e /liF}, 

where /jlT — {/xy : y e F}, By definition, function MFp is exactly the function V, 
that is, MFr(x) — Vix) for all ieR*. The Minkowski function is a norm iff the 
level set is O-symmetric, i.e., xef implies — x e f. The universal of piecewise lin- 
ear functions as Lyapunov candidates implies that any stable switched linear system 
admits a polyhedral C-set as its attractive level set, that is, D + V (x) < —f> for any x 
on the boundary of the level set, where f> is some positive real number. As a result, 
the stability verification reduces to the search of a proper attractive polyhedral C-set. 

A particular and interesting situation is that the common Lyapunov function is a 
norm. In this case, it can be seen that the norm is exponentially contractive along 
any nontrivial state trajectory of the switched system. 

A piecewise quadratic function is in the form 

V ma {x)=ra.ax{x T Ptx: i = l,...,s}, 

where Pi 's are symmetric and positive definite matrices. It is clear that the functions 
are positive definite and homogeneous of degree 2. A level set of V max is an inter- 
section of a number of ellipsoids and is strict convex. As a result, the function is 
also strictly convex and thus can be classified into the first class of the theorem. 

As a corollary of Theorem 2.18, we have the following useful lemma that estab- 
lishes the connection between a stable continuous-time system and its discrete-time 
Euler approximating system. 

Lemma 2.19 Suppose that the continuous-time switched linear system is stable. 
Then, the Euler approximating system defined as 

x(t + 1) = (/„ + xA a )x{t) (2.33) 

is also stable for sufficiently small r . 

Proof The lemma can be proved based on the fact that each stable switched lin- 
ear system admits a polyhedral common Lyapunov function, V. For the level set 
r — {x: V(x) < 1}, define /3 — min A - e g/-o!3(|;c|), where 013 is the class /C func- 
tion as in (2.7), and 8T stands for the boundary of set 7"\ It follows from (2.7) that 
T> + V(x) < —/3 for any x e dr. This clearly indicates that the set r is also attractive 
for discrete-time system (2.33) when r is sufficiently small, which in turn implies 
stability of the discrete-time system for a sufficiently small r. □ 

Remark 2.20 An interesting question is whether or not the degrees of the common 
polynomial Lyapunov functions are uniformly bounded? In other word, does it exist 
a map / : N + x N + !->■ N + such that each m-form attractive switched linear system 
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of order n admits a common polynomial Lyapunov function of degree x( n , m ) or 
less? If the answer is confirmative, then, it is possible to numerically verify the 
stability by checking that, among all polynomials of degree x (n, m) or less, whether 
there is a common Lyapunov function or not. Unfortunately, such a bound does not 
generally exist, even for planar switched linear systems. The reader is referred to 
[168] for detailed analysis. 

Finally, we turn to marginal stability and propose a universal set of common 
weak Lyapunov functions. 

Proposition 2.21 A marginally stable switched linear system admits a norm as its 
common weak Lyapunov function. 

Proof We are to prove that the common weak Lyapunov function V defined in 
(2.13) is a norm. In fact, as 

V(x) + V(y)> sup {\<l>(t,x,o)\ + \4>(t,y,a)\} 
teT ,aeS 

> sup {\</>(t;x,a) + (/>(f,y,a)\}>V(x + y) VijeR", 
teT ,aeS 

V is convex. On the other hand, for any e > 0, there is 8 > such that 

\<p(t;0,x,a)\ <e Vr e T , x e B&, o e S. 

It follows from the radial linearity property (2.18) that V(x) < %\x\ for all x e R". 
This, together with the convexity, implies that 

\V(x) - V(y)\ <V(x-y)< € -\x- y\ Wx, y e R". 



As a result, V is globally Lipschitz continuous. It is obvious that V is 0-symmetric, 
and positively homogeneous of degree one. Thus, it is indeed a norm. □ 

By Theorem 2.18 and Proposition 2.21, a stable (marginally stable) switched 
system always admits a norm as its common (weak) Lyapunov function. 

A switched linear system A is said to be regular if g(A) is finite, where q(A) 
is the largest divergence rate defined in (2.28). It is clear that any continuous- 
time switched linear system is regular and that a discrete-time system is regular 
if q(A) 7^ — oo. For a continuous-time switched linear system A = {A\ , . . . , A m ], 
the normalized switched system is the switched system A = {A\ — q(A)I„, ... , 
A,„ — q(A)I„}. Similarly, for a regular discrete-time system A = {Ai, . . . , A m }, 
its normalized system is defined to be the switched system A = {A\/e e ^\ . . . , 
A m /e e< - A ^}. It is clear that any normalized system is either marginally stable or 
marginally unstable. 



2.3 Switched Linear Systems 35 

2.3.3 Algebraic Criteria 

For a linear time-invariant system, it is well known that the stability is characterized 
by the location of the poles. However, such a concise characteristic is still missing 
for switched linear systems. Nevertheless, much effort has been paid to find alge- 
braic criteria for stability of the switched systems. In this subsection, we present 
some of the criteria which provide necessary and sufficient algebraic conditions. 

For discrete-time systems, the stability is closely related to the convergence of the 
transition matrices, for which numerous algebraic criteria were developed mainly 
by researchers in the mathematics community. In the following, we first address the 
stability and then move to other related properties. 

Suppose that A = {Ai, . . . , A m ] is a finite set of matrices in R" x ". For k e N + , 
denote by n k (A) the set of length-fc products of A, that is, 

n k (A) = {A h ...A ik : ii,...,i k eM}, 

and further 

77(A) = |J 77 t (A), 

keN+ 

which is the set of all products whose factors are elements of A. 

Let | • | be any induced norm, and p(-) be the spectral radius of a matrix. Define 

At(A)=max{||P||:/»e/7it(A)}, (2.34) 

which represents the largest possible norm of all products of k matrices chosen in 
set A. In particular, denote pi(A) by ||A||. The joint spectral radius of A is then 
defined as 

p(A) = limsupp y t(A) 1/ *, (2.35) 

k^+oo 

which is the maximal asymptotic norm of the products of matrices. It is clear that 
p(A) is norm-independent due to the equivalence of the norms. Analogously, define 
the number 

pt(A) = max{ p(P): PeIl k (A)}, 

which represents the largest possible spectral radius of all products of k matrices in 
a set A. Furthermore, define the generalized spectral radius of A as 

p(A) = rimsuppfc(A) 1//: , (2.36) 

k^+oo 

which is the maximal asymptotic spectral radius of the products of matrices. 
Recall that, for a matrix A, we have 

lim \\A k \\ l l k = Urn p{A k ) llk = p(A). 

k^+oo k^+oo 
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Therefore, both the joint spectral radius and generalized spectral radius degenerate 
into the standard spectral radius when A is a singleton. 

We are to present some properties of the joint spectral radius and generalized 
spectral radius. To this end, let T be the set of vector norms in R" . For a set of 
matrices A = {A\, ,,., A m ] and a norm | ■ | e T, define the (induced) norm of A to 
be 

|| A || = max |A,-;c|/|je|. 
The least norm of A is defined to be 

LN A = inf || A|| . 

■|er 

A norm || • || * is an extreme norm of A if 

l|AH* = LN A . 
For a real number /x, /xA denotes the matrix set {/xAi, . . . , /xA m }. 

Lemma 2.22 Suppose that A is a set of real matrices. Then, the following state- 
ments hold. 

(1) p(A)<p(A)<LN A . 

(2) p(/xA) — \fi\p(A) and p(/xA) — | /x | p (A) V/x e R. 

(3) p(A) < 1 implies the stability of A. 

Proof First, note that p(A) < ||A|| for any norm || ■ ||. As a result, pk(A) < pk(A), 
which implies that p(A) < p(A). On the other hand, it follows from the norm sub- 
multiplicativity property that 

P(A)<||A||, 

which leads to the inequality p(A) < LN A . This proves the first statement. 

The second statement trivially follows from the linearity of the spectral radius. 
To establish the third one, observe that p(A) < 1 implies that the state transition 
matrix 0(t,O, a) approaches zero as t approaches infinity for any switching sig- 
nal a, which further implies that the switched linear system is attractive and hence 
stable. □ 

Based on the lemma and the converse Lyapunov theorem presented in Sect. 2.2.2, 
we are able to establish the equivalence among several fundamental indices. 

Theorem 2.23 For any switched linear system A, we have 

p(A) = p(A) = LN A = exp( e (A)). (2.37) 
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Proof By Lemma 2.22, to establish p(A) — p(A) — LNa, we only need to prove 
p(A) > LNa- For this, suppose by contradiction that p(A) < LNa- Fix a real num- 
ber )i with p(A) < /j. < LNa- Denote Bj — A,/ jjl for i = 1, . . . , to, and further 
B = {B\ , . . . , B m } . It follows from Lemma 2.22 that 

p(B)<l<LN B . (2.38) 

Applying Lemma 2.22 once again, the switched linear system B is stable. By The- 
orem 2.18, there is a norm V that serves as a common Lyapunov function of the 
switched system, which is contractive. It is clear that 

LN B < ||B|| v < L 

which contradicts inequality (2.38). This establishes 

p(A) = p(A)=LN A . 

By the definition of the largest Lyapunov exponent as in (2.28), it is clear that 

exp(e(A))<LN A . 

Using a similar idea as in the former part of the proof, we arrive at the conclusion 
that the equality relation must hold. This completes the proof. □ 

The equality between the generalized spectral radius and the joint spectral radius 
allows us to term the quantity as the spectral radius of matrix set A, denoted p(A). 

Corollary 2.24 The discrete-time switched linear system is stable iff its spectral 
radius is less than one. It is unstable iff its spectral radius is greater than one. 

The corollary provides a new criterion for stability of a switched linear system in 
terms of the spectral radius, which extends the well-known spectral radius criterion 
for linear time-invariant systems. A semi-decidable verification procedure can be 
developed based on the criterion, which will be presented in Sect. 2.4. 

Proposition 2.25 A discrete-time switched linear system A is marginally stable iff 
it admits an extreme norm with ||A||* = 1. 

Proof By Proposition 2.21, marginal stability implies the existence of a common 
weak Lyapunov norm V . From the definitions for the common (weak) Lyapunov 
function, we have V(A,x) < V(x) for all i e M and x e R", which implies that 
||A||y < 1. If LNa < L then the switched system is asymptotically stable, which 
contradicts the assumption of marginal stability. As a result, we have LNa > 1 . As 
LNa < l|A||y, we have LNa = l|A||y = 1, which clearly shows that \\ ■ \\v is an 
extreme norm for the switched system. 
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Conversely, suppose that the switched system admits an extreme norm | • || with 
||A|| — LNa — 1. It is clear that the system is either stable or marginally stable. If 
the system is stable, then, there is a common Lyapunov norm Vo such that 

V (Aix) - V (x) < -co(x) VieR", i e M, 

where a> is a continuous positive definite function. Let /3 = minv ( A: ) = i co(x). It fol- 
lows that 

Vo(Aix) - V (x) < -pVo(x) VxeR", ie M, 

which further implies that ||A|| v < 1 — fi, a contradiction. Therefore, the switched 
system must be marginally stable. □ 

Next, we move to the case of continuous time. For any norm | ■ | in R", the 
induced matrix measure on R' 1X " is defined as 

\x + xAx\ — \x\ 
/x M (A)= limsup —^ — . (2.39) 

r— s-0+,|jc|=1 r 

It is clear that the matrix measure possesses the following properties (see, e.g., [253]. 
The subscript | ■ | is dropped for briefness): 

(1) Well-definedness. The matrix measure is well defined for any vector norm. 

(2) Positive homogeneousness . /x(aA) = afi(A) for all a > and A e R" x ". 

(3) Convexity. fi(aA + (1 - a)B) < a/x(A) + (1 - a)fi(B) for all a e [0, 1] and 
A,BeR" x ". 

(4) Exponential estimation. \e A 'x\ < e^ A)t \x\ for all f > 0, x € R", and A e 

nnxn 

The definition of the matrix measure is extendable to a set of matrices A = 
{Ai, . . . , A m ] as follows. For a set of matrices A = {Ai, . . . , A m ] and a norm | • | 
in R" , the (induced) measure of A w.r.t. | ■ | is defined as 

/X|.|(A) = max{/x M (A 1 ),...,/X|.|(A m )}. (2.40) 

It can be verified that the measure possesses the positive homogeneity and convexity 
properties as the matrix measure. As for the exponential estimation property, it can 
be seen that 

\(p(t;0,x,a)\<e^ (A)t \x\ Vt > 0, x e R", a e S. (2.41) 

Furthermore, for a set of matrices A = { A i , . . . , A m } , define the least measure value 
as 

v(A)= inf ui.i(A). (2.42) 

\-\sT ' 

Any matrix set measure /j. with /x(A) = v(A) is said to be an extreme measure for A. 
It is well known that the switched linear system A is (exponentially) stable if there 
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exists a norm | ■ | such that its matrix measure is negative. As an implication, when 
the least measure is negative, then the switched system is exponentially stable. In 
the following, we are to establish that the converse is also true. 

Theorem 2.26 For any continuous-time switched linear system A, we have 

v(A) = e(A). (2.43) 

In addition, the switched system admits (at least) one extreme measure iff its nor- 
malized system is marginally stable. 

Proof Firstly, it can be verified that 

/x|.|(A + ^/„) = A. + /x|.|(A) V|-|eT, XeR, 

where A + XI„ denotes the switched linear system (Ai + XI n , . . . , A m + XI n ). As a 
result, we have 

v(A + XI n ) = X + v(A) VAeR. 

This, together with the fact that 

Q(A + XI n ) = X + Q(A) VXeR, 

indicates that (2.43) holds for general case if it holds when q(A) — 0, that is, the 
switched system is either marginally stable or marginally unstable. 

Secondly, suppose that the system is either stable or marginally stable. Fix a 
vector norm | ■ | in R" and define the function V : R" i-> R+ by 

V(x)= sup \<j>(t;0,x,cr)\. (2.44) 

teR+, aeS 

It can be seen that the function is well defined, positive definite, convex, 0-symmet- 
ric, and positively homogeneous of degree one. In addition, there is a positive real 
number L such that 

\x\<V(x)<L\x\ VxeR". 

This, together with the radial linearity property (2.18), implies that V is globally 
Lipschitz continuous. As a result, the function V in fact forms a vector norm of R". 
Thirdly, for any x eR", s e R+, and i e M, we have 

V((p(s;0,x,i))= sup \(/>(t;Q,(/>(s;0,x,l),a)\ 
teR + ,aeS 

< sup \<j)(t + s;0, x,a)\ 

teR + ,aeS 

< sup \(j>(t + s; 0, x,(t)\ 
(t+s)eR + ,aeS 

= V(x), 
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where i stands for the switching signal i (t) = i . As V is Lipschitz continuous, we 
further have 

V(x + tAix)-V(x) 
fi v (Ai)= hmsup — — 

V((P(r;0,x,i))- V(x) 
— hm sup 

r^o+,.t^o rV(x) 

< Vi e M. 
That is, the norm V induces a matrix set measure that satisfies 

Mi/(A)<0, (2.45) 

which further implies that v(A) < 0. 

Fourthly, we focus on the situation that the switched system is marginally stable. 
We claim that the least measure value is exactly zero. Indeed, if it is negative, then, 
it follows from relationship (2.41) that the system is (exponentially) stable, which 
yields a contradiction. This means that the matrix set measure in (2.45) is an extreme 
measure. 

Finally, consider the case that the switched system is marginally unstable. It is 
clear that the least measure value is nonnegative. Assume that it is positive. Then, 
there is a positive real number e with e < v(A) such that 

V|.|(A-e/„)>0, 

which further means that the switched system A — el n is either unstable or 
marginally unstable. This is a contradiction since q(\ — el„) — — e < 0. The con- 
tradiction means that the least measure value is zero. On the other hand, when the 
least measure value is zero, the existence of an extreme measure implies the bound- 
edness of the attainability set R(A), and hence the switched system is either stable 
or marginally stable. As a result, a marginally unstable switched system does not 
admit any extreme measure. 

To summarize, marginal stability implies the existence of an extreme measure of 
zero value, and marginal instability implies zero least measure value but does not 
admit any extreme measure. As the normalization does not alter the existence of an 
extreme measure, the second statement of the theorem follows. □ 

Remark 2.27 For a real matrix, its largest divergence rate is the largest real part 
of its eigenvalues, which is exactly the least measure value. This fact was pointed 
out in [274]. Theorem 2.26 extends the fact to the case of switched linear systems, 
though the concept of system spectrum is missing for switched linear systems. 

Remark 2.28 The function V in the proof is in fact a (weak) common Lyapunov 
function for the switched linear system (cf. Proposition 2.21). The observation that 
it serves as a vector norm is crucial in the development. 
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With the help of Theorem 2.26, we can fully characterize the stabilities in terms 
of matrix set measure. 

Corollary 2.29 For a continuous-time switched linear system, we have the follow- 
ing statements: 

(1) The system is stable iff its least measure value is negative. 

(2) The system is marginally stable iff its least measure value is zero and it admits 
an extreme measure. 

(3) The system is marginally unstable if and only if its least measure value is zero 
and it does not admit any extreme measure. 

(4) The systems is unstable iff its least measure value is positive. 



2.3.4 Extended Coordinate Transformation and Set Invariance 

In linear systems theory, coordinate transformation and system equivalence are pow- 
erful tools in stability analysis. For switched linear systems, coordinate transforma- 
tion also plays an important role in converting a switched system into a new one 
with clearer and/or simpler structural information, which enables us to analyze the 
stability properties in a more convenient manner. However, the standard notion of 
equivalence coordinate change does not directly work, and we need to extend the 
notion in a way that it is capable of rigorous stability analysis. 

Definition 2.30 Suppose that T e R nxr is a constant matrix. The linear coordinate 
change x = Ty is said to be an extended coordinate transformation for the switched 
linear system if the matrix T is of full row rank, that is, rank T — n. 

It is clear that the transforming matrix could be nonsquare in that the number of 
columns might be larger than that of rows. Under the extended coordinate change, 
the switched system is converted into 

y+ = T + A Ty, (2.46) 

where T + denotes the Moore-Penrose pseudo-inverse of a matrix T. Note that the 
transformed system is r -dimensional. The system is said to be the extended trans- 
formed system of the original switched linear system. Note that the process of ex- 
tended coordinate transformation is nonreversible, that is, the original system is not 
necessarily an extended transformed system of (2.46). 

Recall that a matrix A — (aij) in R" x " is said to be strictly (column) negatively 
diagonal dominant if 

an + 2, \ a ji\ < 0' i — I, . . . ,n. 

Note that this can be equivalently characterized by /Lti(A) < 0, where pi is the 
matrix measure corresponding to the £i-norm. 
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Theorem 2.31 The switched linear system is stable iff there exists an extended co- 
ordinate transformation such that the extended transformed system admits a con- 
tractive I -norm in discrete time or a negative l-measure in discrete time. 

Proof Note that, if the extended transformed system admits a contractive 1 -norm in 
discrete time or a negative l-measure in discrete time, then the extended transformed 
system is stable. It follows from x — T y that the original switched system is stable. 
To establish the converse relationship, we first consider the discrete-time case. As 
the system is stable, it follows that it is also exponentially convergent. Therefore, 
there is a piecewise linear function that serves as a common Lyapunov function, 
V(x) — \Fx\qc. The Lyapunov function can be rewritten in the dual representation 

V0c) = min{|A|i: x = Xh, heR r }, 

where X is a matrix of full row rank. The duality relationship comes from the fact 
that the set of column vectors of [X, —X] is the set of vertices of the level set r — 
{x e R" : V(x) < 1}. Let {xj : j = 1, ... ,s} be the set of vertices of r. By the 
symmetry of F, we have that s — 2r, and we can reindex the vertices such that 
Xk+r — —Xk for lc — 1, . . . , r. As the level set is attractive w.r.t. the switched system, 
there is X e [0, 1) such that 

A t xj eir Vi e M, j = 1, . . . , s. (2.47) 

This is equivalent to the existence of vectors p l . with \p l -\\ <X such that 

Ajxj = Xp) VieM, j = 1, . . . , r. (2.48) 

Define 

Pi = [p[,...,pll i = l,...,m. 
It is clear that || Pj ||i < A, Equations (2.48) can be rewritten as 

AiX = XP it ieM, 

which leads to the first statement of the theorem. 

The case of continuous time can be treated based on the above reasonale for dis- 
crete time. In fact, by Lemma 2.19, there always exists a sufficiently small positive 
real number r such that the discrete-time Euler approximating system 

x(t+ l) = (I„ + xA a )x(t) 

is also stable. This, together with the fact that the extended transformed system 
admits a contractive 1-norm, yields 

(I n + tAi)X = XPi, i = l,...,m (2.49) 
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for some full row rank matrix X eR" xr and matrices P, with || P, || i < 1 . It is clear 
that (2.49) can be equivalently expressed by 

A i X = X{P l :-I„)/t, i = l,...,m, 

which directly leads to the conclusion with H, ■ — (P, ■ — /„)/r. □ 

Remark 2.32 It is interesting to note that, for a linear time-invariant system 
x + — Ax, the criterion degenerates into the matrix relation AX — XP in discrete 
time and AX — XH in continuous time, where X is a matrix of full row rank, P is 
a square matrix with ||P||i < 1, and H is a strictly negatively diagonal dominant 
matrix. This criterion for stability contains interesting information as discussed be- 
low. The equality AX — XP can be reasonably seen as the generalized similarity 
between A and P. In this sense, a matrix is Hurwitz iff it is generalized similar to 
a strictly negatively diagonal dominant matrix. For the switched linear system, it is 
stable iff the subsystem matrices are simultaneously generalized similar to strictly 
negatively diagonal dominant matrices. In discrete time, it is interesting to note that 
any stable switched system is generalized similar to a system which admits the norm 
| ■ 1 1 as its common Lyapunov function. 

To further identify the subtle properties of marginal stability and marginal insta- 
bility, we take a view of invariant sets that start from an origin-symmetric polyhe- 
dron Aq which contains the origin as an interior point. An example of Aq is the 
polyhedron with extreme points whose entries are either 1 or — 1 . Define the set 

Aoo = {x e R" : 4>(f, 0, x, a) e A Vt eT , a e S}. (2.50) 

It can be seen that Aoo is the largest (positively) invariant set contained in Aq for 
the switched system. 

Proposition 2.33 The following statements hold: 

(1) If switched linear system A is stable or marginally stable, then, Aoo contains 
the origin as an interior point, and Aoo H dA$ ^ 0, where 3Aq is the boundary 
of Aq. Conversely, if Aoo contains the origin as an interior point, then, the 
system is stable or marginally stable, and Aoo n 9/lo ^ 0. 

(2) If the system is marginally unstable, then, Aoo H 8Aq ^ 0, and Aoo C Aq D H, 
where H is a nontrivial subspace ofR". 

(3) The switched system is unstable if Aoo — {0}. 

Proof It is clear that Aoo is origin-symmetric. Furthermore, it can be seen that it 
is convex and closed. Another observation is that, as Aoo is an invariant set for the 
system, XAoo is also an invariant set for any X > 0. Therefore, Aoo H 8Aq ^ iff 

For the first statement, note that the (marginally) stable system admits a common 
weak Lyapunov function, V. Define 

v — maxjr e R: V(x) <r=>ie Aq], 
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A v = jieR": V(*) < u}. 

As Ay is an invariant set contained in Aq, we have that Aqc D Ay, and thus it 
contains the origin as an interior point. Conversely, suppose that Aqc contains the 
origin as an interior point. As Aqc is invariant w.r.t. the system, the system is stable 
or marginally stable. 

For the third statement, suppose that Aqq — {0}. Define 

yl, = {xeR": 4>(s; 0, x, a) eA Vse [0, t], a eS}, t e %, 

and further 

r)(t) = sup{|x|: x e A t ], t e T . 

It can be seen that the function r\ is decreasing and approaching to zero. As the 
function is continuous, there is a time x e % such that 

1 
??(t) < -inf{x: x e dAo}- 

That is, for any X < 2, we have XA r C Aq. Define 

A\ = {x e R" : </) k (s; 0, x, a) eA Q Wse [0, r], a e S}, 

where (p x denotes the state for switched system {(1 — X)A\, ..., (1 — X)A m ] in dis- 
crete time and for {A\ — XI n , . .., A m — XI n ] in continuous time, where /„ is the 
nth-order identity matrix. It can be seen that A\ C (Aq) when A is a sufficiently 
small positive real number. This means that the above matrix set is neither stable 
nor marginal stable, which further implies the instability of the original system. 

Finally, we prove the second statement. As A^ — {0} implies instability as 
proved previously, A^ ^ {0} for marginal instability. As A^ is convex, 0-sym- 
metric, and containing the origin as a boundary point (w.r.t. R"), it induces the 
nontrivial subspace H of R" given by 



H^yjXAoo. (2.51) 



. def I 

It is clear that Aoc C H, and this completes the proof. □ 



A byproduct of Proposition 2.33 is the following system decomposition lemma. 

Lemma 2.34 A marginally unstable switched linear system is simultaneously block- 
triangularizable. That is, there exist a nonsingular matrix T and two positive inte- 
gers n i , «2 with n i + «2 = w such that 



Ai^T- l A,T 



Aj Af 
A? 



, i e M, (2.52) 
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where A? and A? are n\ x n\ and «2 x w 2> respectively. In addition, both A = 
{ A },..., A m } an</ A — { Ay , . . . , A 2 } are marginally stable as switched linear sys- 
tems of dimensions n\ and n%, respectively. 

Proof Let H be the subspace defined in (2.51), and let further n\ — dim// and 
n2 — n — n\. The nontriviality of H implies that 1 < n\ < n. Let H 1 - be the subspace 
orthogonal to subspace H with H © H — R n , Let T be a nonsingular matrix whose 
first «i columns belong to H and the others belong to H 1 - . The block-triangular 
structure of (2.52) comes from the fact that H is A; -invariant for all i e M. In- 
deed, for any x e H, there exist y e Aoo and X e R + such that x = Xy. As A^ is 
A, -invariant, we have 

Ajx — XAiy e XAoc C H. 

It is clear that the switched system A 1 = {Aj, .. . , A^} is either stable or marginally 
stable, and the marginal stability of the switched system A 2 = {A 2 , . . . , A 2 } can be 
derived as follows. If the switched system A 2 is marginally unstable, then it also 
admits a nontrivial invariant subspace. In this case, it can be seen that, besides the 
subspace T~ l H, the switched block-triangular system A = {Ai, . . . , A m } admits 
another nontrivial invariant subspace, denoted //'. We can prove that T~ l H + H' 
is A,-invariant for all i e M, which further implies that H + TH' is A,-invariant 
for all i e M. This contradicts the definition of H as it is the largest invariant sub- 
space under A, for i e M. The contradiction exhibits that the switched system A 2 
is either stable or marginally stable. However, the (exponential) stability of the 
switched system A 2 would imply marginal stability of the switched system A. Thus 
the switched system A 2 must be marginally stable. Finally, note that the original sys- 
tem is marginally stable if the switched system A 1 is stable, and thus the switched 
system A 1 must be marginally stable. □ 

Finally, by means of the triangular structure in (2.52), it is possible to estimate 
the rate of growth for state norm. 

Proposition 2.35 Suppose that the switched linear system A is marginally unstable. 
Then, there is a polynomial P with degree less than n such that 

\(/)(f,0,x,a)\<P(t)\x\ VieR", t e%, aeS. (2.53) 

Proof For continuous time, write e Ai ' = \ e ' G if, f) . As both A 1 = {A}, . . . , A l m } 

L e A > ■' J 

and A 2 = {A 2 , . . . , A 2 } are marginally stable as switched linear systems, each A- 
is either stable or marginally stable for i e M and j = 1, 2. As a result, there exists 
a polynomial vanishing at zero and with degree less than n, denoted Pi (?) = p\t + 

h p n -\t"~ l , such that the absolute value of each entry of G, (t ) is upper bounded 

by Pi (t) for all i e M and t e To. Without loss of generality, we assume that all the 
coefficients of Pi are nonnegative. Fix an arbitrarily given switching signal a e S 
and a time t e %, and let to = 0, . . . , t s be the switching time sequence in [to, t) and 
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io, ■ ■ ■ , i s t> e the corresponding switching index sequence. It is clear that the state 
transition matrix <t>(t; to, a) — e Ai s (t ~' s ' > ■ ■ ■ e A <o (?1_fo) is of the form 



<P{t;tQ,a) = 



e^'-V ■■■€"'<> 



^A'-^ . . . Jl (tl ~ to) 



where 



Q = G is {t-t s )e A l-^- , ^ ) ...e A >- t0) 

+ e A l {, -^G is _, (t s - f,_i)/ ? '-2<'-i-'-*> ■ ■ ■ e ^ ( "-' 0) 

+ . . . + e A l('-'^ . . . e X >-* ] G h (t 2 - h )e A l ( "- ,0) 
, a) (t-t s ) a) (t 2 -ti)„ . . 

It can be seen that the marginal stability of A 1 and A 2 implies the existence of an up- 
per bound, denoted k, for the entries of the corresponding state transition matrices. 
It follows that each entry of Q satisfies 

\QU, l)\ < nK 2 (Pi(t - t s ) + Fife - f,_i) + ■ ■ ■ + Pi(fi - to)) 
< riK P i (t — to) , j = 1 , . . . , n i , / = 1 ni, 

where the latter inequality comes from the fact that Pi vanishes at the origin and 
its coefficients are nonnegative. It follows that the norm of <P(t; to, <r) is upper 
bounded by n 2 K 2 (l + P\(t — to)). As a result, the norm of the state transition matrix 

<P(fJo,cr) is upper bounded by P(t-t ) = \\T\\\\T~ 1 \\n 2 K 2 (l + P]_(t -t )), which 
is a polynomial with degree less than n. This clearly leads to the conclusion. 

The discrete-time case can be proceeded in a similar manner, and the details are 
left to the reader. □ 

The proposition reveals the fact that there is a gap between exponential diver- 
gence of instability and divergence rate of marginal instability which is bounded by 
a polynomial with degree less than the system dimension. 

Corollary 2.36 For any n-dimensional regular switched linear system A, there is a 
polynomial P with degree less than n such that 

\<p(t; 0,x,o)\ < P(t)e 0(A)t \x\ Vx e R", t e %, a e S. (2.54) 

Moreover, P can be chosen to be of degree zero iff switched system A is marginally 
stable. 
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Example 2.37 Let us examine the continuous-time two-form switched linear system 
with subsystem matrices 



Ai = 



-10 0a 
2-100 
0-23 
0-1 



A 2 = 



-1 


2 











-1 














-1 











3 


-2 



where a is a real number. It is clear that both subsystems are stable, and the switched 
linear system admits a block triangular structure, 



A, 



A/.i A/,3 
A ia 



1,2. 



When a — 0, it can be verified that the quadratic function 
V(x)=x T Px, P = 



1 














1 














3 


- 








-1 


3 



is a common weak Lyapunov function. By Proposition 2.6, the switched system 
is stable or marginally stable. On the other hand, it can be seen that the convex 
combination j (A i + A2) is marginally stable, and hence the switched system is not 
(asymptotically) stable [80]. As a result, the system is marginally stable. 

When a ^ 0, the switched system is marginally unstable due to the coupling 
between the two marginally stable modes. It is readily seen that the system is already 
in the form specified by Lemma 2.34. Let Aq — {x eK 4 : ^£_i l x 'l — "•}• The 
largest invariant set Aqo contained in Aq satisfies 



def 

A V2 = 







X'3 
x 4 



V2O) < 1 > C Aoc C 







*3 

X4 



|*3| + |X4|<1 



where V2CO = 3x? + 3x^ — 2^3x4. Figure 2.1 depicts the sets in the X3 — X4 plane. 
Finally, due to the block-triangular structure of the switched system, the system 
solution satisfies 



Jo 



\x l (t)\ < K[\x l (0)\ + I K[\ax4(r)\dr <Ki\x 1 (0)\+aKiK2t\x 2 (0)\ 



\x 2 (t)\<K 2 \x 2 (0)\, 



where x 1 = [xi, X2J T , x 2 — [x$, X4] T , and k\ and k% are the largest possible norms 
of the state transition matrices w.r.t. subsystems {A,,i} and {A,-^}, respectively. It 
is clear that the state norm is bounded by a polynomial of degree one, which is 
consistent with Proposition 2.35. Figure 2.2 presents a sample state trajectory with 
a — 1 . It is clear that the state norm grows linearly. 
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-1 -0.8 -0.6 -0.4 -0.2 



0.2 0.4 0.6 0.8 1 



Fig. 2.1 Sets A , A^, and A Vl 

2.3.5 Triangularizable Systems 

In this subsection, we focus on a special class of switched linear systems which 
either possess an upper (lower) triangular structure or are simultaneously equivalent 
to triangular systems. Triangular systems are interesting because they have simple 
structures, and many nontriangular systems can be made to be triangular by means 
of equivalence transformations (simultaneous triangularization). 



Definition 2.38 The switched system is said to be simultaneously (upper) triangu- 
larizable if the matrix set A = {A\ , . . . , A m } is simultaneously triangularizable, that 

is, there exists a complex nonsingular matrix T e C" x " such that B k — T~ l AkT, 
k e M, are of the upper triangular form, 



B k = 



'h(l, 1) 







b k (hn)' 



b k (n,n) 



eC" 



keM. 



(2.55) 



Note that we allow complex matrices as the equivalence transformation. For a 
simultaneously triangularizable matrix set, we can transform it into the following 
real normal form. 
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8 10 12 

Time (Sec) 



Fig. 2.2 Sample state trajectory 



Lemma 2.39 Suppose that a system A = {A\, . . . , A m \ is simultaneously triangu- 
larizable. Then, there exists a real nonsingular matrix G, such that G~ A k G is of 
the normal form 



A k ^G-'A k G- 



A\k * 

A 2k 











* 
* 

Aik 



(2.56) 



where I <n, A- ]k is either a I x I or 2x2 block, and the size of the jth block A- ]k 
is the same for all k e M. In addition, if Aj k is of '2x2, then it is of the form 



Ajk 



-0)jk IJ-jk 



(2.57) 



Proof As the matrix set {Ai,...,A m } is simultaneously triangularizable, for 
any polynomial p{y\, . . . ,y m ) over R, the eigenvalues of p(A\, ,,.,A m ) are 
p{b\ (i, i), . . . , b m (i, i)), i = 1, . . . , n. This exhibits that the matrix set possesses 
Property III in [85, p. 442]. By Theorems 1 and 9 in [85], there is an orthogonal 
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matrix H e R" x " such that 



B k ^H~ l A k H = 



B\k * 
B 2k 



B, 



Ik 



(2.58) 



where / < n, and for any fixed j < /, we have 

(i) Bji, . . . , Bj m are 1 x 1 ; or 
(ii) Bj\, . . . , Bj m are 2x2, with one of these matrices, say, Bj q , of the form 



B jq = 



'./'/ 



'.i>i 



u .ii 'ji. 



U j q > 0, Vj q > 0, 



and each of Bs k , k e M, is a real linear polynomial gj k in B ]q , that is, Bj k — 
8jk(B jq ). 

As Bj q in (ii) possesses a pair of (conjugated) complex eigenvalues, it follows from 
the standard matrix theory that there exists a real nonsingular matrix Tj e R 2x2 such 
that 



T-'BjqTj 



-(Ojq [Ijq 



where fij q , coj q e R. Furthermore, as any polynomial of the matrix \__". J q ~\ is 



still of the same form, we have 

T - i Bj k Tj= gjk (T7 l B jq Tj) = 



fljk o>jk 
_—0)j k fljk 



lijk,a>jk G R, ke M. 



Define K — diag[A"i , . . . , K{\, where Kj — 1 if the corresponding block in (2.58) is 
lxl, and Kj — Tj if the block is 2 x 2. Letting G — HK, the theorem follows. □ 

Remark 2.40 Simultaneous triangularization of matrix sets has been investigated 
extensively; see, for example, [5, 176, 195, 204] and the references therein. In partic- 
ular, the following classes of matrix sets (and the corresponding switched systems) 
have been proven to be simultaneously triangularizable: 

(a) The system matrices are commutative pairwise, that is, AiAj — AjAi, i, j e M 
[182]. 

(b) The Lie algebra generated by the system matrices is solvable [1, 147]. 

(c) A ={A U A 2 } and rank^ A 2 -A 2 A l )= 1 [137]. 



For switched linear systems that are simultaneously triangularizable, it is possible 
to judge the stability directly upon the eigenvalues of the subsystems. In fact, we can 
go further to characterize the largest rate of convergence (cf. (2.28)) explicitly. 
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Theorem 2.41 For any simultaneously triangularizable switched linear system A, 
the largest divergence rate is 

o(A) = maxmax9tt,-(Ait) (2.59) 

keM ;=i 



in continuous time and 



in discrete time. 



p(A) = maxmax Aj(A^) (2.60) 

keM i = l ' ' 



Remark 2.42 Note that (2.59) and (2.60) only involve eigenvalues of the system 
which are easily calculated. To apply the theorem, we do not necessarily need to find 
a linear transformation that converts the system into the triangular form. Instead, we 
only need to confirm that the system is simultaneously triangularizable. 

To prove this theorem, we need the following technical lemma. 

Lemma 2.43 A switched system A = {A\, . . . , A m }, where Ak is in normal form 
(2.56), is stable iff each Ak is stable. 

Proof Suppose that the switched system is stable. Then it is clear that each subsys- 
tem is also stable. 

On the other hand, if each A^ is Hurwitz in continuous time, then we can con- 
struct a common Lyapunov function of the form v(x) — x T Px for the switched 
system. Indeed, for the Bk defined in (2.58), let ji,...,ji denote the size of 
Bic(l, 1 ),..., Bk(l, I), respectively. Define 

P = diag[l jv q 2 lj 2 , ..., qilj{[, 

where positive numbers qi, ...,q\ are chosen so that the minors of the matrix 
— {ATP + PAk) of order 1, . .. ,n are positive for all k e M. In this way, the 
switched system possesses a common Lyapunov function and thus is stable. 

The discrete-time counterpart can be established in a similar manner, and the 
details are omitted. □ 

Proof of Theorem 2.41 We proceed with the continuous-time case, and the discrete- 
time case could be proven in a similar manner. Suppose that there exists a real 
nonsingular matrix G such that for each k e M, the matrix Ak — G~ l AkG is of the 
triangular form (2.56). 

Consider the switched system A — yl = {Ai — yl n , ..., A,„ — yl n ], where y 
is any given real number. Let A™ ax denote the largest real part of the matrix Ak. 
Suppose that y > max^gM ^™ x , then it can be seen that each Ak — yl n is Hurwitz. 
It follows from Lemma 2.43 that the switched system A — yl„ = {A\ — yl n , ... , 
Am — yln} is stable. This in turn implies that 

e (A-yI n )<0 
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Accordingly, we have 
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e( A ) = e( A ) < Y- 



n(A)<maxA? i 

keM 



On the other hand, it can be seen that 



As a result, we have 



o(A) > max p(Ak) — max^ 
keM keM 



keM 



D 



Corollary 2.44 A simultaneously triangularizable switched linear system is asymp- 
totically stable iff each subsystem is stable. 

Example 2.45 For the continuous-time switched system A = {Ai, A2} with 



Ai = 



1 



-1 



A 2 = 






2 





-2 


-1 





1 


-2 


-: 



it can be verified that the eigenvalues are { — 1, — 1, —3} for A\ and { — 1, —0.5 + 
1.9365v^T, -0.5 - \.9365^-i} for A 2 , and AiA 2 - A 2 Ai is of rank one. It 
follows that the switched linear system is simultaneously triangularizable (cf. Re- 
mark 2.40), which further implies that the switched system is exponentially conver- 
gent with the rate of —0.5. 



2.4 Computational Issues 

In the previous section, we presented quite a few stability criteria, mostly for stabil- 
ity and some for marginal stability. In this section, we briefly discuss the possibility 
of verifying the conditions of the criteria in terms of appropriate computational pro- 
cedures. 



2.4.1 Approximating the Spectral Radius 



For discrete-time switched linear systems, it follows from Corollary 2.24 that the 
verification of asymptotic stability can be reduced to the calculation of the spectral 
radius. Indeed, if the spectral radius can be exactly calculated in a finite time, then 
the verification problem is decidable, that is, there exists a computational proce- 
dure that produces either "yes" or "no" answer in a finite time. In the literature, 
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it was conjectured that, for any finite matrix set A, there exists a finite k such 
that p(A) = p~fc(A) ' , This conjecture is well known as the Finiteness Conjec- 
ture, which was finally disproved by counterexamples. As a result, it remains an 
open problem for the verification of asymptotic stability. Nevertheless, by Corol- 
lary 2.24 and the fact that p(A) = infj. eN + pk(A) ' , the verification problem is 
semi-decidable by verifying the relationship Pk(A) < 1 for k — 1,2,... and termi- 
nating at the first confirmative instant. On the other hand, the problem of instabil- 
ity verification is also semi-decidable by verifying the relationship pk (A) > 1 for 
k — 1,2,... and terminating at the first confirmative instant. The problem of veri- 
fying the marginal stability, however, was shown to be undecidable. 

While it is hard to exactly calculate the spectral radius of a matrix set, it is possi- 
ble to compute an approximation as follows. 

Proposition 2.46 For any norm and natural number k, we have 

max p(B) l/k <p(A)< max \\B\\ l/k , keN+. (2.61) 

Bsn k (A) Ben k (A) 

Proof First, observe that, for any natural number j , we have 

max p(B) J < max p(B). (2.62) 

Bsn k (A) Ben kj (A) 

Indeed, the set of matrix products that can be expressed as the jth power of an 
element in FI^ (A) is a subset of 77^- (A). Inequality (2.62) follows from the equality 
p(A j ) = p(A) j . Rewrite (2.62) to be 

max p(B) 1/k < max p(B) [/kj , (2.63) 

Ben k (A) Ben kj (A) 

which implies that 

max p(B) i/k <lim sup max p(B) 1/kj . 

Ben k (A) j^+oo Ben kj (A) 

On the other hand, it follows from Fl kj (A) C US n ' ( A ) that 

lim sup max p(B) ' ■' <lim sup max p(B)' 1 , 

j^ +0C Ben kj (A) ,-^ +00 Be/7,(A) 

which, together with inequality (2.63), leads to the first inequality of (2.61). 
To establish the second inequality of (2.61), define 

£ =max{||Ai ||, ... , ||A m ||}. 

For any nature number /, there are nonnegative integers v and j with j < k such 
that I — kv + j . For any index sequence i\, . . . , i\ in M, we have 
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v-1 J 

\\A il ■■■A il \\ < Y\{\\ A ki+iA kl+2 - ■ ■ A kt+k \\)Y\\\A kv+t \\ 

(=0 i=l 



( max II SlA t j . 
\Ben t (A) / 



It follows that 



( max \\B\\) <( max \\B\\) t->' 1 , 

\Ben,(A) / \fie/7i(A) > 



which, by taking / -*■ +00, yields 



p(A)< max \\B\\ l/k . 
Ben k (A) 



D 



Remark 2.47 The proposition provides two-side bounds for the spectral radius. 
Based on this relationship, a computational procedure is readily developed to 
approximate the spectral radius. With a sufficiently large k, the approximation 
can be made arbitrarily accurate. For stability verification, it suffices to termi- 
nate the procedure when either maxBen k (A) p(B) > 1, which implies instability, or 
maxBen k (A) \\B\\ < 1 that implies stability. While a merit of this approximation is 
that at each step the approximating accuracy can be estimated, the procedure is not 
computationally efficient as the cardinality of TJ k (A) grows exponentially with k. 
Another drawback of the estimate is that both sequences maxBen k (A) p(B) l / k and 
maxB e n k (A) II fill 1 ''* are not necessarily monotone w.r.t. k, which means that the ap- 
proximate accuracy of estimate (2.61) is not necessarily increasing as k increases. 
The following example clearly illustrates this. 



Example 2.48 Let M — {1, 2}, and 

-1 -73" 
-0.9V3 -0.9 



A 2 : 



-0.9 -0.9V3~ 

73 -1 



Table 2.1 shows the calculated joint/generalized spectral radii and the differ- 
ences that represent the accuracy errors, where p k — maxBen k (A) p(B) l ^ k , p k — 
maxBen k (A) ll-SII 1 ^ an d e k — p k — p k . It is clear that all the sequences are oscillat- 
ing. 

To obtain a guaranteed precision of a spectral radius estimate, we take a poly- 
nomial common Lyapunov approach, which could provide guaranteed accuracy by 

Table 2.1 Estimated spectral 
radii and error bounds 



1 2 3 



p k 1.8974 1.8974 1.9652 1.8974 1.8974 1.9652 1.8974 
p k 2.0000 1.9860 1.9654 1.9739 1.9709 1.9654 1.9702 
e k 0.1026 0.0886 0.0002 0.0765 0.0735 0.0002 0.0728 
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searching a proper common Lyapunov function in a preassigned set of polynomi- 
als. For this, we first restrict ourselves to the case of quadratic common Lyapunov 
functions and then extend the searching to sum-of-squares polynomials. 

If the switched linear system admits a quadratic Lyapunov function, then, by 
solving the linear matrix inequalities 

AfP + PAj <0, i = l,...,m 

for symmetric matrix P, the asymptotic stability is decidable via effective algo- 
rithms. Based on this idea, we define the ellipsoid norm for matrix set A by 

p L (A) = inf{ / aeR + :3 P > s.t. Aj PA t <p 2 P, i = l,...,m}. 

It can be seen that the ellipsoid norm could be equivalently defined to be 

Til 

p L (A) = inf max II A( || P , (2.64) 

P>0 (=1 



where || A,- \\p — max^o J x T Aj P Aix / -J x T P x is the P-norm. 
Proposition 2.49 ^- < p(A) < p L (A). 

To proceed with the proof, we need the following supporting lemma that is part 
of the well-known John's theorem [128]. 

Lemma 2.50 Suppose that Q C R" is an origin- symmetric compact convex set with 
nonempty interior. Then, there is an origin-centered ellipsoid E such that 

EcfiC s/nE, (2.65) 

Proof of Proposition 2.49 It follows from the definition of pl(A) that 
P (A) < pl (A) . Therefore, we need only to establish that p (A) > PL y> . 

By Theorem 2.23, for any positive real number e, there is a norm | ■ | such that 

l|A|| <p(A) + e. (2.66) 

It is clear that the unit ball Q — {x e R" : |x| < 1} is origin-symmetric, compact, 
and convex. It follows from Lemma 2.50 that there exists an ellipsoid E — {x e R" : 
x T Px < -} such that relation (2.65) holds. This implies that 



Vx r Px < \x | < -Jny/x T Px, 
which, together with inequality (2.66), further implies that 

AfPAi<(p(A) + e)nP. 
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This leads to 

max II A, II p < Jnip (A) + e) . 

By the arbitrariness of e, we have 

Pl(A) — inf max ||A,-||p < -Jnp{K). 
P>0 ieM 

This completes the proof. □ 

Remark 2.51 Proposition 2.49 establishes that the ellipsoid norm approximation ad- 
mits a guaranteed precision that relies on the system dimension. In particular, the 
approximation is exact for scalar systems. For higher-order systems, the approxima- 
tion is tight in that Proposition 2.49 does not generally hold when y/n is substituted 
by a smaller number. Therefore, finding a common Lyapunov function becomes 
more and more difficult as the system dimension increases. 

To improve the approximation precision, a natural idea is to use higher-order 
polynomials as common Lyapunov functions. A suitable class of polynomial Lya- 
punov functions is the set of homogeneous polynomials that can be expressed as 
sums of squares. 

A polynomial p is said to admit a sum-of-squares representation if there are 
polynomials pi, ..., pk such that 



P (x) = ^(/7,(x)) 2 VieR". 



A polynomial is said to be a sum-of-squares if it admits a sum-of-squares represen- 
tation. 

It is clear that a sum-of-squares is always positive semi-definite, and it is positive 
definite if polynomials pi, i — 1, . . . , k, do not admit a common root. Moreover, 
a homogeneous sum-of-squares admits a quadratic representation as stated below. 

Lemma 2.52 A homogeneous polynomial p(x) of degree 2d is a sum-of-squares if 
and only if 

p(x) = (x [d] ) T Px [d] , (2.67) 

where x^ ' is a vector whose entries are monomials of degree d in x, and P > 0. 

For a proof of the lemma, the reader is referred to [184, 203]. 

Example 2.53 Suppose that we try to find a sum-of-square representation for the 
polynomial 

p(x[, x-i) — 2;tj + 2,x\xi — x^x 2 + 5x 2 . 
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For this, let x^ — [x},x\X2,xi~\ T . Then, try the representation as in (2.67) that 



reads 



\x\ x { x 2 x%] 



PU PU P\3 

P12 P22 P23 



If J 1 



X[X2 
v 2 



_Pl3 P23 P33_ 
= PllXi + 2pi2x\x 2 + 2p23X\x\ + (p 2 2 + 2pn)x\x\ + P33X%- 

Solving p(x) — (x^) T Px^ gives 
/?n=2, pu = l, 2pi3 + P22 = ~l, P23 = 0, P33 = 5. (2.68) 

To obtain a positive semi-definite P satisfying the equalities, we can use the semi- 
definite programming technique, which corresponds to the optimization of a linear 
function over the intersection of an affine subspace and the cone of positive semi- 
definite matrices. Specifically, we take the following semi-definite programming: 

minimize 

subject to tr(B, P) = b h i = l,...,5, 
P>0, 

where Bj and £>, are chosen to represent the ith equation, i — I, ... ,5. For instance, 
to represent the third equation, 2/?i3 + P22 = — 1, we should choose 



B 3 









f 





1 





1 









bi 



■1. 



It turns out that a feasible solution of the semi-definite programming is 

-3" 



P = 



2 1 
1 5 
-3 5 



In this way, polynomial p is represented by a sum-of-squares as 

p{x)—-\(2x\ — 3xl + x\X2) +(x\ + 3x\X2) ]. 

To utilize the sums of squares to approximate the spectral radius, we need the 
following lemma. 

Lemma 2.54 Suppose that p is a positive definite homogeneous polynomial of de- 
gree 2d that satisfies 



p(Atx) < yp(x) VieR", ;' e M, 



(2.69) 



for some y > 0. Then, we have p(A) < y ld . 
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Proof By the positive definiteness and continuity of p, we have 

< min p(x) — a\ < max p(x) — 0(2 < +oo, 
[jc | = i *l = l 

which, together with the homogeneity, implies that 

a 1 \x\ 2d <p(x)<a 2 \x\ 2d . 



For any natural number k and B G YI k (A), there exist an index sequence £i, ... , i^ 

■ A/p It is cL 

"»* ' ' ' A'^1 



with elements in M such that B — Aj k ■ ■ ■ A ;i . It is clear that 



I A,-, ■ ■ ■ A,. II = max ■ 

xjto \x\ 



fa 2 \ 13 

— rr 
\ai/ x 



i 

p(A ik ■ ■ ■ A h x) 
max 



i 

012 \ 1Z 

Y 



7*0 p{x) 

k/2d 



As a result, we have 



,1/4 



p(A) = lim sup max \\B\\ ' <y 2d . 

k ^ +0Q Ben k (A) " D 

It is clear that, for any homogeneous polynomial p, there always exists a positive 
real number y that satisfies inequality (2.69). 



Example 2.55 For the planar discrete-time two-form switched linear system A with 

A 2 : 



a 
a 



a 

-a 



where a is a positive real number, simple calculation gives 

max p(B) l/k = a, k=l,2,.... 
Ben k (A) 

As a result, the spectral radius of the switched system is a. Using a common 
quadratic Lyapunov function, the upper bound on the spectral radius is equal to 
\Fla. As a result, only when a < y, we can find a common quadratic Lyapunov 
function for the switched system, which implies the (marginal) stability of system. 
On the other hand, take the sum-of-squares homogeneous polynomial of degree four 

V(x) = {x\ - xj) 2 + e{x\ + x|) 2 , 

where e is a positive real number. We could verify that, for any b < |, there is a 
sufficiently small e such that ba 4 V(x) — V(A,x) is a sum-of-squares. It follows 
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Fig. 2.3 Sample phase portrait and level sets 



from Lemma 2.54 that 



P(A) 



/ 4 y/« 
-U) a 



In particular, when a < Q) 1//4 ^ 0.9306, we conclude that the switched system is 
stable. It is interesting to note that the level sets of V(x) are nonconvex, as shown 
in Fig. 2.3, where a — 0.93 and e — 0.01. 

The following lemma, presented in [21], characterizes the ability of sums of 
squares to approximate a norm. 



Lemma 2.56 For any norm \ ■ \ and natural number d, there exists a homogeneous 
polynomial p(x) of degree 2d such that 

(1) p is a sum-of-squares and 

(2) for all x e R" , we have 



p(x) 2d < \x\ <tc„p(x)2d. 



(2.70) 



where4 = ( n+d r 1 )^. 
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Recall that ( .) is the number of combinations, ( .) = .„£_ .,, , where k\ is a fac- 
torial. When n is fixed and d is sufficiently large, we have 



K|?»l 



2d 



(n- \)\nd 



This means that, for any positive real number e, there is a sufficient large integer 
d such that k„ < 1 + e. As an implication, by choosing sufficiently large J, the 
estimate in (2.70) can achieve any preassigned accuracy. 

Let HP^ be the set of homogeneous polynomials of degree k defined on R" , and 
SOS^' be the subset of HP^ that are sums-of-squares. Define the quantity 

p 2 s d (A) = M peBP -y2J 
subject to peSOSl, 

YP(x) - p(A iX ) e SOS£ . 

With the help of the above notation, we are ready to state the main result of the 
subsection. 

Theorem 2.57 Suppose that d is a natural number. Then, we have 



pf(A) 



< /o(A) < fig (A). (2.71) 



To proceed with a proof of the theorem, we need some further auxiliary material. 
First, it follows from Lemma 2.54 that 

p(A)<pf(A). (2.72) 

Another observation is that, when d — 1 , HPj is exactly the set of quadratic polyno- 
mials, and SOSj is exactly the set of positive (semi-)definite quadratic polynomials. 
For any positive real number e, there is a norm | • | such that 

p(A)> ||A||-e. 

By Lemma 2.56, we have 

p(A)>^-pj(A)- e , 



where the equality (") = -Jri is used. By the arbitrariness of 6, we obtain 

P(A) > -Ul(A). (2.73) 

Note that the approximation is the same as in Proposition 2.49. 
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Next, for a vector x € R" and a natural number k, define the £-lift of x, denoted 
x^ k \ to be the vector with components {\fa\x a } a , where a — (ai, . . . , a n ) e N'l, 



Y^!i—\ oti — k, and a\ denotes the multinomial coefficient a! 
when n — 2, we have 



For example, 



*M = 



*2 



x [2] = 



V2xiX2 

,-2 



x [3] = 



V3^lX2 

V3xi;c| 

*2 J 



It is clear that x™ is of dimension N„ — (" f ). For standard Euclidean norm, it 
can be verified that 



U W I = I*I* 



£=1,2, 



(2.74) 



On the other hand, for any matrix A e R nx '\ there is an induced matrix A^ € 



R w n xiv « satisfying 



A M x M = (Ajc) w VxeR". 



(2.75) 



It can be shown that the operation defines an algebra homomorphism that preserves 
the structure of matrix multiplication. In particular, for any n x n matrices A and B, 
we have 



(AS) 



M 



M R W 



A LKJ 5 



1,2,. 



(2.76) 



Integrating properties (2.74), (2.75) and the definition of spectral radius, we can 
obtain the following lemma. 

Lemma 2.58 For a matrix set {A\ , . . . , A m ] and a natural number k, we have 



\[k] 



p{Af,...,A^) = p{A 1 ,...,A m f 



(2.77) 



Finally, with the help of the above preparations, we are ready to prove Theo- 
rem 2.57. 

Proof of Theorem 2.57 Note that 



P 2 s(A 



M 



Af l ) = inf{y : P > 0, y 2d P - (AfJ PA) di > 0, » = 1 



[d]\T 



ltd] 



inf{y : p(x) > 0, y 2d p(x) - p(A [di ) > 0, i = 1, 

(p¥w) d , 



(2.78) 



where the notation p(x) = (A [d] ) T PA\ d] and the fact that y 2d p(x) - p(A\ d] ) e 

N d 

SOS," have been used. Combining Lemma 2.58 with inequalities (2.73) and (2.78) 
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p(A) d = p(A\ a K...,AW) 



1 



1 

fit* 



P 2 s(A 



M 

1 ' 



4?) 



(pf(A))' 



As a result, we have 



P(A) > 



/of (A) 



which, together with inequality (2.72), leads to inequalities (2.71). The proof of 



Theorem 2.57 is completed. 

Example 2.59 For the four-dimensional three-form switched system with 



□ 



Ai = 



A 3 = 






1 


7 4 


1 


6 


-2 -3 


-1 


-1 


-2 -6 


3 





9 1 


1 


4 


5 10" 





5 


1 -4 





-1 


4 6 


-1 


5 


1 



A 2 = 



-3 


3 







-2 


1 


4 


9 


4 


-3 


1 


1 


1 


-5 


-1 





it can be calculated that p\ = 9.761 and p\ — p\ — 8.92. As p(AiA 3 )2 = 8.915, 
we conclude that the spectral radius is between 8.915 and 8.92. It is clear that p A s 
provides a much closer upper bound for the spectral radius than pj,. 



2.4.2 An Invariant Set Approach 

An approach for verifying the stability of the switched system is to find an appro- 
priate piecewise linear common Lyapunov function. 

Let us start from an initial polyhedron Aq which is origin-symmetric. An exam- 
ple is the polyhedron with extreme points whose entries are either 1 or — 1 . Recall 
that for any 0-symmetric polyhedral set A, there is a full column rank matrix Fa 
such that A — {x: |F^;t|oo < !}• Another representation is A — {Xj\0('- \oe\i < 1}, 
where Xa = \x\, ■ ■ ■ , X r ] is full row rank and {±jti , . . . , ±x r } are vertices of A. For 
a 0-symmetric polyhedral set A, define the set 



C(A). 



Aix e A, i = 1, 



2.4 Computational Issues 63 

It is clear that 

C(A) = {x: IF^Ajjcloo^l, i = l,...,m}, 
which is also a O-symmetric polyhedron. Define recursively a set of polyhedra by 

A k = C(A k -i)C\Ao, it =1,2, .... (2.79) 

The largest invariant set contained in Ao, as defined in (2.50), is the set 

Aoc= n a*. 

£sN+ 

Note that, if Aj. = Ak+\ for some A: e N+, then A^ = A&, and the set is tractably 
computed. 

Proposition 2.60 For any initial polyhedron Aq, we have the following statements: 

(1) If the discrete-time switched linear system A is stable, then, there is a finite 
number k such that Ak — Ak-\, which means that Ak — Aqo. Conversely, if 
Ak — Aii-i for some k < +oo, then, Ak — Aqq, and the system is stable or 
marginally stable. 

(2) If there is a finite number k such that Ak is interior to set Aq, then Acq = {0}, 
and the switched system is unstable. 

Proof For the former statement, let x (■) be a state trajectory of the switched system. 
The exponential stability implies the existence of a time T with x(t) e Aq for t > T 
whenever x(0) e Aq. For any lc — 0,1, ... ,T, Ak has the property that x(0) e Ak 
implies that x (k) e Aq, and visa versa. This means that Aj + i — At- Indeed, if this 
is not true, then, there is a state trajectory x(-) withx(O) € Aj/At+i, which implies 
that x(T + 1) ^ Aq, which is a contradiction. Conversely, if Ak — Ak-\ for some 
k < +oo, then, it is clear that Ak — Aqq is a polyhedral C-set that is an invariant set 
for the system. Thus the system is stable or marginally stable. 

For the latter statement, we only need to show that A^ = {0}. As A^ is an 
invariant set for the system, it can be seen that XAoc is also an invariant set for any 
A. > 0. As the set Aqq is interior to the set Aq, there is X > 1 such that AAqq C Aq. 
This in turn implies that XA^ C Aj. for all k e N + , which yields XA^ C A^. As a 
result, we have Aqo = {0}. □ 

It is interesting to notice that Ak — Aqc does not necessarily implies the (expo- 
nential) stability. A particular example is the case that A = {/„}, which produces 
Ak = Aqq = Aq for any k e N + . In fact, if we add the identity matrix to any sta- 
ble system, we have a marginally stable system which produces the same polyhe- 
dral set sequence Ao, A\ , To further distinguish between stability and marginal 

stability, one possible way is to test through the recursive procedure by setting 
A= {XA[, . . . , XA m ], where A. > 1, but A. — 1 is sufficiently small. If Ak — Ak-\ for 
a finite k, then, the original system must be stable. Otherwise, the original system is 
either marginally stable or stable but "nearly marginally stable". 
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Based on the above discussion, we can develop a computational algorithm that 
verifies the stability of the discrete-time switched linear system. 

Algorithm for calculating the largest invariant set (ACLIS) 

Initiation. Set F° :— Fa , X° :— Xj\ ,flag :— 0, and k :— 0. Prespecify a natural 

number kmax. 
Step 1. Set F :— F k , X :— X , and compute the matrix 

G = [(F k A 1 f,...,(F k A m f] T . 

Step 2. For each row G' of G, check if || G' X || oc < 1 . If yes, remove the row from 
matrix G. 

Step 3. If flag — and G is the vacant matrix, that is, it is x 0, then output the 
matrix X and the "stability or marginal stability" message, set flag :— 1 and go to 
Step 7. If flag — 1 and G is the vacant matrix, then terminate with the message 
"stability". 

Step4. Set H := [F T ,G T ] T . Compute A k+l = {x e R" : \Hx\oo < 1} and set 
F k+1 :=F$+ 1 zndX k + 1 :=X Ak+ i. 

Step 5. If flag — and ||F X' :+1 || oo < 1, then, terminate with the message "in- 
stability." If flag — 1 and \\F°X k+1 ||oo < 1, then, terminate with the message 
"marginal stability or nearly marginal stability." 

Step 6. Set k :— k + 1. If k > kmax, terminate with message "time is out." Other- 
wise, go to Step 1 . 

Step 7. Set a sufficiently small positive number X, and A, = (1 + X)A, for i = 
\,...,m. Set ^° := F, and go to Step 1. 

It can be seen that the algorithm is not efficient as the number of extreme points 
of polyhedra Ak may grow exponentially. Within a recursive loop, the main com- 
putation load is in Step 4, which computes the various representations of the new 
polyhedron. Fortunately, this can be implemented by commercial softwares (e.g. 
Matlab Geometric Bounding Toolbox [252]). 

For continuous-time switched linear systems, it was established in Lemma 2.19 
that, if the system is asymptotically stable, then, its Euler approximating system 

x(t+l) = (I n + vA a{t) )x(t) (2.80) 

is also asymptotically stable for sufficiently small r. A verification procedure can 
thus been outlined as follows. 

Step 1. Choose a sufficiently small positive real number r. 

Step 2. Run the Algorithm ACLIS for system (2.80). If the algorithm terminate with 

stability, then, set A^ = A^ and go to Step 4. Otherwise, go to Step 3. 
Step 3. Set r = x 12 and go to Step 2. 
Step 4. Check if A^ is positively invariant for the original system. If yes, then 

terminate with the message "the continuous-time system is stable". Otherwise, go 

to Step 3. 



2.5 Notes and References 65 

Note that the fourth step can be conducted with the help of Theorem 2.31. Gen- 
erally, there is no guarantee that the procedure terminates in a finite time even for 
stable switched systems. As a matter of fact, the stability verification for continuous- 
time switched systems is still an open problem for further investigation. 



2.5 Notes and References 

This chapter introduced the fundamental issues which are relevant to the develop- 
ment of guaranteed stability theory for switched dynamical systems. As a matter of 
fact, the development of stability theory for switched systems is not isolated. On 
the contrary, the progress actively interacted with stability and robustness issues for 
several different system frameworks of various backgrounds, as briefly discussed in 
Sect. 2.3.1. Indeed, when the switching path is taken as a perturbation variable, the 
stability of a switched system is in fact robustness against a class of time-varying 
uncertainties. This can be seen from expression (2.1) where the switching signal 
a{t) is an unknown time-varying perturbation. A unique feature of the perturbation 
is that its image set is finite and thus isolated. By taking convex linear combinations 
as in (2.20) and (2.21), the switched system is naturally connected to the polytopic 
uncertain system and the relaxed differential inclusion. As these classes of dynam- 
ical systems share the same stability properties, it is natural that the stability theory 
for switched systems has been deeply interacted with that of other system frame- 
works. To fully understand the major progress in the stability analysis of switched 
systems, it is important to highlight the various sources of literature from the related 
disciplines. 

The first source of literature is the absolute stability analysis for Lur'e systems. 
A Lur'e system is a linear plant with a sector-bounded nonlinear output feedback. 
Specifically, a SISO Lur'e system is mathematically described by 

x(t) = Ax(t) + b<p{y), x e R", y e R, 

y(t) = cx(t), k iy 2 <y<p(y)<k 2 y 2 . (2.81) 

The problem of absolute stability is to determine the exact bound of k\ and k 2 
that guarantee global asymptotic stability of the system. The research on this 
problem could be traced back to the 1940s, and the early pioneers were mainly 
from the Russian applied mathematics community (Lur'e [157], Aizerman [4], 
Yakubovich [271], etc.). Aizerman [3] conjectured that, if for each k e [kiiki], 
the matrix A + kbc is Hurwitz, then the Lur'e system is [jfci, ^-absolutely sta- 
ble. This is equivalent to the statement that the stability of each convex combina- 
tion of A + k\bc and A + k 2 bc implies the stability of the switched linear system 
A = {A + k\bc, A + k 2 bc). While this conjecture was disproved by counterexam- 
ples, it did greatly stimulate the study on the problem of absolute stability. Quadratic 
Lyapunov functions (sometimes plus an integral of nonlinearity) were sought by 
Lur'e himself and many other researchers. A quadratic Lyapunov function for the 
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Lur'e system is in fact a common Lyapunov function for the extreme systems. That 
is, the existence of a common Lyapunov function for A + k\bc and A + k2bc im- 
plies [k\, ^-absolute stability of the Lur'e system. In the 1970-1980s, many re- 
searchers realized that the quadratic Lyapunov functions are not universal for ab- 
solute stability, and they turned to more general nonquadratic Lyapunov functions. 
Piecewise quadratic Lyapunov functions were proved to be universal for absolute 
stability [170-172]. 

The second source of literature is the boundedness analysis for the infinite prod- 
ucts of a set of (complex or real) matrices A = {A\, . . , , A m ). This topic has been 
quite active since the 1990s, and the literature can be traced back to the 1950s [260]. 
It was widely recognized that the joint spectral radius is an index that is closely re- 
lated to the boundedness of the matrix semigroup [199]. The joint spectral radius 
and the generalized spectral radius were proved to be equal for any finite set of 
matrices [25, 69]. Berger and Wang [25] established that a discrete-time switched 
system is asymptotically stable iff the spectral radius is less than one. As the spec- 
tral radius is equal to the least possible induced norms [69], the asymptotic stability 
is equivalent to the existence of a contractive norm. This norm is in fact a com- 
mon Lyapunov function for the matrix set. To verify the boundedness, Lagarias and 
Wang [138] conjectured the existence of a finite k such that the generalized spec- 
tral radius p(A) = f>k(A) l l k for any given finite matrix set A. This well-known 
Finiteness Conjecture was finally disproved [39, 45], which indicates that the ex- 
act computation of the spectral radius might be very involved. On the other hand, 
Brayton and Tong [47, 48] developed constructive procedures for stability verifi- 
cation. The procedures search a piecewise linear common Lyapunov function by 
recursively approximating its level set. While the computational algorithms are not 
efficient, the method itself is valuable as it clarifies some useful properties that ben- 
efit the forthcoming investigations. Besides the mathematical characteristics, there 
has been much effort to establish the connections among various notions from the 
dynamical system's viewpoints. In particular, the notions of vanishing-step(VS)- 
stability, bounded-variation(BV)-stability, and para-contractility were introduced, 
and their relationships with the left-convergent-products (LCP) property (all left- 
infinite products converge) were established [255]. There were also a few works 
focusing on the more subtle situation that the spectral radius is one, which corre- 
sponds to either marginal stability or marginal instability. Among these, the notion 
of defectivity and its properties were investigated [69, 96]. 

The third source of literature is the robustness analysis for a class of polytopic 
linear uncertain systems. When a linear nominal system 

x{t) — A x(t) + Bou(t) 

is perturbed by a time-varying uncertainty with a polyhedral bound 

d(t) eco{A\x(t), . .,, A m x(t)}, 

the perturbed system can be described by 

x(t) — A x(t) + B u(t) + d(t) — A(w(t)) + B u(t), 
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where co(t) e {w e R m : to,- > 0, YJiLi w i = l ) and A ( w ) = A o + TT=i w i A i- 
A more general description is 

x(t) = A(m(t)) + B(co(t))u(t), 

where the input gain matrix is also perturbed. For this class of systems, the main 
problems are of various (gain-scheduling, robust) stabilizing design and robustness 
analysis. Blanchini and his coworkers [30, 32, 34] developed a nonquadratic Lya- 
punov scheme for stabilizing design of polytopic linear uncertain systems. By de- 
veloping a Brayton-Tong-like recursive procedure, it was possible to evaluate both 
the transient performance and the asymptotic behavior of the linear uncertain sys- 
tems [33]. 

The fourth source of literature is the stability of differential inclusions. Differen- 
tial inclusions provide a unified representation of a wide class of dynamical systems. 
For a differential inclusion 

x{t)eF(x{t)) 

and its relaxed convex system 

x(t) e co F(x(t)), 

the solution sets for both systems admit a common closure (w.r.t. an appropri- 
ate normed functional space) [13, 83]. This implies the fact that the two systems 
share same stability properties. This observation bridges the stability theories for 
the switched linear system, the polytopic linear uncertain system (without control 
input), and the linear convex differential inclusion, as the last one can be seen as 
the relaxed system for the former two. On the other hand, it has long been estab- 
lished [135, 188] that an asymptotically stable differential inclusion admits a strictly 
convex and homogeneous Lyapunov function. This paves the way for finding more 
universal sets of Lyapunov functions. Indeed, as a strictly convex level set can be 
arbitrarily approximated via a polyhedral set or an intersection of a set of ellipsoids, 
both sets of piecewise linear and piecewise quadratic functions are universal. 

Finally, the literature on switched and hybrid systems has grown rapidly since the 
1990s. The common Lyapunov function approach was proposed based on the fact 
that, if all the subsystems share a common Lyapunov function, then the switched 
system is stable under arbitrary switching. Much effort was paid to find criteria for 
the existence of common quadratic Lyapunov functions for switched linear systems. 
Narendra and Balakrishnan [182] found that, if all linear subsystems are stable with 
commuting A-matrices, then they share a common quadratic Lyapunov function. 
The commutation condition in fact implies the simultaneous triangularizability, and 
for this, the commutation condition can be further relaxed [1, 164]. The commut- 
ing criterion was recently extended to switched nonlinear systems [256]. For planar 
switched linear systems, complete criteria for common quadratic stability were es- 
tablished [53, 204]. There were a few works reporting various converse Lyapunov 
theorems [64, 159, 168], which in fact can be seen as special cases of the earlier 
results in different contexts [34, 152, 173]. 
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It should be noticed that, while many early studies focused on one-system frame- 
work, more and more researchers took advantage of the tight connections among the 
schemes [146, 149, 173, 234]. A notable example is that most researchers from var- 
ious backgrounds realized the limitation of quadratic Lyapunov functions in tack- 
ling the stability and robustness problems for linear and quasi-linear systems, which 
leads to the active research into the nonquadratic Lyapunov approach. Another ex- 
ample is that the constructive criterion for the stability of planar switched linear 
systems [112] also provides a solution for the absolute stability of planar Lur'e sys- 
tems [163]. 

While the above review provides a brief survey on the relevant literature, it only 
mentioned a small fraction of the existing results, methods, and literature. The reader 
is referred to [31, 62, 63, 146, 148] and references therein for more details. 

In this chapter, we tried to integrate novel ideas, fresh methods, and rigorous 
results from various schemes into a systematic framework. The richness of the rel- 
evant material enables us to highlight the most notable progress within a unified 
framework. 

The notational preliminaries in Sect. 2.1 were adapted from the books [146, 234]. 
The common Lyapunov function approach presented in Sect. 2.2 is a combination 
of several works including [31, 152, 224]. In particular, the notion of the common 
strong Lyapunov function is a mixture of the smooth version [159] and the locally 
Lipschitz version [30], and the notion of common weak Lyapunov function was 
taken from [224]. 

In Sect. 2.3, Lemma 2.11 can be found in [117], and Proposition 2.13 was 
adapted from [221]. As for Theorem 2.15, the fact of the equivalence between 
asymptotic stability and exponential stability was reported in [82, 139] for differ- 
ential inclusions. The equivalence between local attractivity and global exponential 
stability was established in [8] for switched systems. The context of universal Lya- 
punov functions in Sect. 2.3.2 was mainly adapted from [173]. The continuous-time 
version of Propositions 2.21, 2.33, and 2.35 and Lemma 2.34 were adapted from 
[224], where their discrete-counterparts can be found in [22, 25, 33, 69], respec- 
tively. A simplified proof was presented in [156] for Proposition 2.35 in discrete 
time. Proposition 2.25 was reported in [69] for discrete-time systems and in [223] 
for continuous-time systems. The important algebraic criterion, Theorem 2.31, was 
adapted from [32, 173]. The context in Sect. 2.3.5 on triangular systems was adapted 
from [239]. While conceptually simple, the research on simultaneous triangulariza- 
tion has been quite active, which impacts greatly on the common Lyapunov function 
approach. 

The computational issues presented in Sect. 2.4 highlight some progress in calcu- 
lating the spectral radius of a matrix set and verifying the stability of the correspond- 
ing switched system. It has been revealed that the computation of the joint spectral 
radius is NP-hard, and the stability verification "p(A) < 1" is undecidable [41, 251]. 
This reveals that effective approximating of the joint spectral radius is difficult in 
general. Nevertheless, much effort has been paid in investigating the approximation 
issues, and the reader is referred to [7, 37, 95, 158, 190, 249] and the references 
therein. Proposition 2.46 and Example 2.48 were taken from the thesis [249]. The 
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accuracy of the ellipsoidal norm approximation, Proposition 2.49, could be found 
in [7, 38]. The approximation by means sum-of-squares homogeneous polynomial 
Lyapunov functions, which forms the main content of Sect. 2.4.1, was largely bor- 
rowed from [190]. The recursive procedure for calculating the largest invariant set 
contained in a polyhedron, which forms the main content of Sect. 2.4.2, was adapted 
from [33]. It is also possible to investigate the stability through the largest invariant 
set containing a polyhedron [47, 48, 193]. 



Chapter 3 
Constrained Switching 



3.1 Introduction 

In the previous chapter, we addressed the stability issues for switched systems under 
arbitrary switching. In many practical situations, however, the switching signals are 
subject to various constraints. For instance, the switching is governed by a random 
process, that is, the switching times form a random process with known stochastic 
distribution. Another example is that the switching is autonomous in that a switch 
occurs when the state enters into a preassigned region. In either case, the set of 
possible switching signals is only a fraction of the set of arbitrary switching signals, 
as discussed in the previous chapter. For these constrained switched systems, while 
the stability criteria for arbitrary switching is still applicable to the stability analysis, 
the criteria are no doubt too conservative. In this chapter, we present new approaches 
that lead to less conservative stability analysis for the constrained switched systems. 
We focus on three types of constrained switching, namely, the random switching, 
the autonomous switching, and the dwell-time switching. 



3.2 Stochastic Stability 
3.2.1 Introduction 

A stochastic switched system is a hybrid system that consists of a set of deterministic 
subsystems and a random switching law that coordinates the switching among the 
subsystems. The random nature of the switching mechanism enables such systems to 
be widely representative in many real-world processes with abrupt variable structure 
and/or unpredictable component failure. For the special case where the subsystems 
are linear and the switching is governed by a Markov process, the switched system is 
known to be a jump linear system. A jump linear system is mathematically described 
as 

i(t) = A <r (f)X(t), (3.1) 
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where x(t) e R" is the continuous state, cr(t) is a time-homogeneous irreducible 

def 

Markov stochastic process taking value in the finite discrete state space M — 
{1, .. ., m], and A, e R" x ", i e M, are known real constant matrices. Suppose that 
<& — (irij) m xm is the infinitesimal matrix of the process a(t). Therefore, the sta- 
tionary transition probability is 

ft (a(r + *) = yk(o = = ff v * l + f C * ) ' '? J : *>o. 

\l + fuh + o(h), i=j, 



3.2.2 Definitions and Preliminaries 

Denote the underlying probability space by (Q,T, Pr), where Q is the space of 
elementary events, J 7 is a a -algebra, and Pr is a probability measure. Let E be 
the set of probability measures on M. Let xq e R" and p e E be the initial state 
and initial distribution of cr(t), respectively. Given an event co € £2, the continuous 
state evolution of system (3.1) is denoted by (/>(■; xq, a>) or x(-) in short. The state 
transition matrix over time interval [s\, $2] is denoted by <P (s%, S\, &)), which is a 
random matrix. 

Given an initial probability distribution m — Pr{cr(0) = i] for i e M, the proba- 
bility distribution p(t) — [Pr{er(r) = 1}, . .., Pr{cr(f) = m}] T satisfies 

p(t) = V T p(t). (3.2) 

The irreducibility assumption implies the existence of an invariant distribution p = 
[pi, . . . , p m ] T that is globally attractive, i.e., i^p = and lim f ^-|_oo p(t) — p. 

Let = ?o < fi < ti < ■ ■ ■ be the sequence of switching times. Denote t ; _i = 
ti — tj-i forj — 1,2, It is clear that To, Ti, T2, .. . are successive duration (so- 
journ) times between jumps. The duration at a discrete state i e M is exponen- 
tially distributed with parameter — i/r;; . The corresponding switching index sequence 
cr(fo), cr(fi), erfe), ... is said to be the embedded Markov chain of the switching 
signal. This discrete Markov chain is with transition probability 




Pr{a(tk+i) = j\(r(t k ) = i] 



It is clear that the joint sequence (r ; , a(tj)), j —0,1,2, .. ., also is a Markov chain. 
It can be seen that the joint sequence uniquely determines the switching signal, 
and vice versa. The stationary (invariant) probability distribution for the embedded 
Markov chain can be computed to be 



pl^ll Pmfn 



Em , \-^m , 



(3.3) 
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The transition matrix over [to, tk\ can thus be expressed by the switching sequence 
as 

0(t k , t ) = e Aa{ 'k-0 Tk - 1 ■ .. e A "W ri e Aa '^ ro . (3.4) 

Definition 3.1 The jump linear system is said to be 

• (asymptotically) mean square stable if for any initial state xo and initial distribu- 
tion p, we have 



lim Ep\\4>(t;xo,(o)\ } = 







• exponentially mean square stable if for any initial state xo and initial distribution 
p, we have 

E p {\4>(t;xQ,(0)\ 2 }<pe- at \x o \ 2 

for some positive real numbers a and fi independent of the initial condition 

• stochastically {mean square) stable if for any initial state xo and initial distribu- 
tion p, we have 

f + °° 2 

I E p {\<j>(t; xq,co)\ }dt<+oo 
Jo 

• (asymptotically) almost surely stable if for any initial state xo and initial distri- 
bution p, we have 



Prf lim \d>(f,XQ,(o)\ = o] = 1 



Remark 3.2 It is clear that the first three stabilities are moment stabilities, while the 
last one is sample stability. The mean square stabilities can be extended to 5-moment 
stabilities (where S is a positive real number) by simply substituting the square 
power by 5-power in the definition. Another simple observation is that exponential 
mean square stability implies both mean square stability and stochastic stability. 



3.2.3 Stability Criteria 

Recall that a Hermitian matrix P e C nxn is said to be positive definite if z*Mz > 
for all nonzero complex vectors z, where z* denotes the conjugate transpose 
of z. Let P\, . . . , Pjc be a sequence of complex or real matrices. The sequence 
P — (Pi, . . . , Pk) is said to be (semi-)positive definite, denoted P > (P > 0), if 
each matrix is Hermitian and positive (semi-)definite. For two real n x n matrices A 
and B, denote by A <g) B their Kronecker product, and by A @ B their Kronecker 
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sum. Taking n — 2 for example, we have 



■ B = 



anB ayiB 
Q2\B CI22B 



a\\b\\ a\\b\i anhi a\ib\i 

ailt>2l aub22 «12^21 012^22 

021^11 «21^12 «22^11 «22&12 

fl21^21 a 2{b22 fl 22^21 022^22 



and 



A©fi = A<g>/„ + /, ! <g>£ = 

«21 

Note that both A <g> B and A © B are of n 2 x n 2 



an + b n b\2 an 

£>2i an+^22 

«21 fl22 + ^ll 



&21 





«12 
^12 

tf 22 + ^22 



Theorem 3.3 For the jump linear system, the following statements are equivalent: 

(1) The system is mean square stable. 

(2) The system is exponentially mean square stable. 

(3) The system is stochastically stable. 

(4) The matrix diag(Ai © A\ , . . . , A m © A m ) + V 7 <g> l n i is Hurwitz. 

(5) For any real S — (S\ , . . . , S m ) > 0, the coupled (algebraic) Lyapunov equations 



AfPi + PiAi + J^fjiPj 



-S h i = \,. 



(3.5) 



admit a unique solution P = (Pi, 



P,n) > 0. 



To prove the theorem, we need to introduce some auxiliary preliminaries. For 
a matrix X e R" x " ; denote its columns by X\,.,.,X n and define its column 
stacking form to be V(X) — [Xj , . . . , X„] T . Similarly, for a matrix sequence 
Y — (Y\, . . . , Yk) with Yi e R nxn , i — I, . . . ,k, define its column stacking form 
to be V (Y) = [ V T (Yi), . . . , V T (Y k )] T . It is clear that 



\\V(Y)\\ 1 =Y / \\V(Y i )\\ 1 <nY / \\Y i \\i. 
1=1 i=l 

For the jump linear system, let 

Zi(t) = E{x(t)x T '(f)l{<r(0=i}}. «' = l,...,i 
Z(t) = (Z 1 (t),...,Z m (t)), 

where 1m is the Dirac measure. It can be seen that 



(3.6) 



J2W Zi ^h ± X^{* r (0*(0W)=i}} = E[x T (t)x(t)}. (3.7) 



/=i 



(=1 
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Moreover, simple calculation gives 

dZi(t) = (AiZi(t) + Zi(t)Af) dt + E{x T (t)x(t)d(l {a(t)=i] )} 
= (AiZi(t) + Zi(t)Aj)dt 

m 
+ ^2 E { E { xT ( t ) x ( t )l{a(t+dt)=i}l{a(t)=j}}\3 7 t} 
7 = 1 

- E{x T (t)x(t)\ [(y{t)=zi] dt) 

= (A i Z i (t) + Z i (t)Af)dt 

m 

+ ^Vv(o(t + dt) = i\a(t) = j)Zj(t) - Zj(t)dt, 

7 = 1 

which further implies that 

d '" 

— Z t (t) = AtZiit) + Zi(t)Af + J2 fjiZj(t). (3.8) 

7 = 1 

Define the linear mapping 

r(P) = (a (P),..., r m (P)), 

where P = (Pi, . . . , P m ) is positive definite, and 

m 

r,(P) = A,P, + PiAf + J2 fjiPj, i = 1. •■ • . m. 

7 = 1 

Similarly, define the linear mapping T to be 

T(X l ,...,X m ) = (T u ...,r m ) 

with Tj = AfXt + XjAj + Y,"j=\ ^j> x i for / = 1, . . . , m. It follows that we can 
rewrite (3.8) in the more compact form 

z(o = r(z(o). (3.9) 

Finally, define the matrix 

A = diag(Ai ®A U ...,A,„® A m ) + <P T <g> I n i. 
It can be verified that 

v(r(P)) = AV(P), 

V(Y(P))=A T V(P) (3.10) 

for any matrix sequence P — (Pi , . . . , P m ). 
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Define the exponential of r by e r '(P) = J2tS> Tr r '( p )- The exponential of T 
can be defined in the same way. Then, we have the following lemma. 

Lemma 3.4 For any complex matrix P > 0, e rt (P) > and e r '(P) > 0. 

For a proof of the lemma, the reader is referred to [160]. 

With the above preparations, we are ready to prove the main theorem. 

Proof of Theorem 3.3 We proceed to establish (1)-K2), (3)->-(4), (4)->-(5), 
(5)— > (2), respectively. These relationships, together with the straightforward im- 
plications (2)— >{Y) and (2)— K3), lead to the conclusion. 
(1)— >(2): Suppose that, for any p e S, we have 

lim E o \0 T (t,O,co)(P(t, 0,O)) f =0. (3.11) 

r-»+oo Pl ' 

Let = ?o < t\ < ■ ■ ■ be the switching time sequence. It is clear that there exist 
positive real numbers y\ and yi such that 

tk 
Y\ < lim — < Y2, 

k^+oo K 

which further implies the existence of a sufficiently large number k\ such that 

—k<t k <2y 2 k Vk>Ki. (3.12) 

It follows from (3.11) and (3.12) that, for any initial distribution p, there exists a 
sufficiently large natural number ki > k\ such that 

E p {0 T (t,O,co)<P(t,O,co)} <n<l Vt>t K2 , (3.13) 

where n is a real constant. Let k be the largest k-i when p spreads over all the unit 
vectors. It follows that 

E^{0 T (t,O,a})0(t,O,co)} <rj V^S,(>(«. (3.14) 

Simple calculation gives 

E^{0 T (t,O,a)0(t,O,a)}<r 1 j e 4 ' 1KV <fJe~ at Vf (3.15) 

for all t e [t(j-i) K , tj K ] with j — 1,2, ... , where v — max{||Ai ||, . . . , ||A m ||}, ft — 
n e r,KV , and a — —j^~- This directly leads to the conclusion that the system is 
exponentially mean square stable. 

(3)— >-(4): Suppose that the system is stochastically stable. It follows from (3.9) 
that, for any initial configuration, we have 

+OC 

(t)\\,dt 



/ \\e n (Z(Q))Ldt= / \\Z 
Jo ' Jo 
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"+00 

/ 

i = l ' 



m - H 



I Zj (f ) I j dt 



< 



"' ^+oo 

V / E{nx T (t)x(t)l {a(t)=i] }dt 
,=l Jo 

<n I E{x T (t)x(t)}dt < +oo. 

Jo 



Therefore, we have 



p+oo 
JO 



\\e n (X)\\ dt < +oo (3.16) 

/o 

for any real X = (Xj , . . . , X OT ) > 0. For complex X — (X\ , . . . , X m ) > 0, it is clear 

that X < (Kmx(X\)I, . . . , ^m-dx(X m )I). It follows from Lemma 3.4 that relationship 

(3.16) also holds for X — (X\, . . . , X m ) > 0. Furthermore, a complex matrix H can 

be decomposed into two Hermitian matrices as 

H=-(H + H*)+ ^—(H + H*), 

where H and H* denote the complex conjugate and conjugate transpose, respec- 
tively, and a Hermitian matrix can be expressed to be a substraction of two positive 
definite matrices. As a result, we have the decomposition 

H = H l -H 2 + S-i(H 3 - H 4 ), 

where H\, ..., H4 are positive definite. This means that (3.16) still holds for any 
complex X — (X\, . . . , X m ) due to the linearity of e rt . On the other hand, it can be 
routinely verified that 

r+oc f+00 

/ 1^1^ < / \\v(e rt (V-\y)))\\ x dt 

JO JQ 

f+00 

<n 2 l^'CV^GO)!^ VyeR m " , (3.17) 

Jo 

where the former inequality comes from (3.10), and the latter from (3.6). Combining 
(3.16) with (3.17) yields 



/, 



+00 

e At y\\, dt < +00 VyeR" 



(4)— >(5): Let the mappings V- be the inverse of the /th matrix in V with 



which implies that the matrix A is Hurwitz. 
lings Vf be tl 

V(Vf l (y),...,V- 1 (y)) = y VjeR™ 
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Define 

P i = -V i ~ 1 (A~ T V(S)), i = l,...,m, (3.18) 

and P = (Pi, . . . , P m ). It is clear that 

A T V(P i ,...,P m ) = -V(Si,---,S m ). 
It follows from (3.10) that 

V(Y(P l ,...,P m )) = -V(Si,...,S m ), 

which implies that 

Y(P u ...,P m ) + (Su...,S m ) = 0, 

which is exactly (3.5). Suppose that there is another P* — (P*, . . . , P*) satisfy- 
ing (3.5). Then, it can be seen that 

A T V(P l ,...,P,„) = A T V(P?,...,P*), 

which means that V(P) — V(P*) and further P* — P, due to the nonsingularity 
of A. It is clear that 

r(pf,...,pT) = (r(p l ,...,p m )) T = -(Su...,s m ). 

This means that (P[ , ■ ■ ■ , Pj n ~) is a solution to (3.5). By the uniqueness of solution, 
Pi are symmetric for i = 1, ...,m. Furthermore, utilizing the facts that j~ t {e A ') — 
A T e A ' and that A T is Hurwitz, we have 

/ e A 'V(S)dt = A- T \ —e At V(S)dt 
Jo Jo dt 

= -A- T V(S) = V(P). (3.19) 

On the other hand, it follows from (3.10) that 

/ e At V(S)dt= V(e r '(S))dt = vl e r '(S)dt). (3.20) 



Combining (3.19) with (3.20) gives 



-r 

Jo 



e rt (S)dt (3.21) 



whose positive definiteness follows from Lemma 3.4. 

(5)— > (2): Note that the joint process {(x(t), <r(t)) : t > 0} is a time-homogeneous 
Markov process with the infinitesimal generator 

Q = * + &J x T A T *,...,x T A T m ?-\ 
\ ax ox J 
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Define a stochastic Lyapunov function to be 

V(x,a) = x T P a x, (3.22) 

where P — (P\ , . . . , P m ) > is the solution to (3.5) with, say, S — (I, . . . , I). Then, 
we have 

m „ 

(0V)(x, i) = J2 fijVix, j) + x T Aj-V(x, i) 

7 = 1 

= * T ( H ^'' ^ / + ATp + PA ) x = ~ xTjc - 

This implies that 

(0V)(jc, < -aV(x, i) Vj = 1, .. ., m, 
where a — l/max™_j X maK (Pi) > 0. It follows that 

E{v(x(t),(T(t))}<e- c "V(x ,a(0)) Wt > 0, 
which clearly implies the exponential mean square stability. □ 

Remark 3.5 The theorem reveals important and rich information about mean square 
stabilities. First, the stabilities are all equivalent to each other, and thus we do not 
distinguish them any more. Second, the stability admits Lyapunov characteristics 
that extend the standard Lyapunov theory for linear systems. Third, the stability is 
verifiable in terms of the subsystem matrices and the switching transition distribu- 
tion. 

Remark 3.6 From the proof, statement (4) in Theorem 3.3 is further equivalent to 
either 

(4a) Matrix r is Hurwitz 

or 

(4b) Matrix T is Hurwitz. 

Note that Matrix A is of m« 2 -dimension. As the Lyapunov operators r and T are 
defined over the symmetric matri 
approximately half that of the A . 



defined over the symmetric matrix group, they are of — vj -dimension, which is 



Remark 3.7 It can be proven that statement (5) in Theorem 3.3 is equivalent to the 
following statement 

(5a) There is a sequence P — (P\ , . . . , P m ) > 0, such that r(P) < 0. 

Besides, statements (5) and (5a) still hold if r is replaced by T. 
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Remark 3.8 It is interesting to observe that a mean square stable jump linear system 
always admits a component-wise quadratic Lyapunov function as in (3.22). In con- 
trast, for a deterministic switched linear system, the existence of such a Lyapunov 
function is a sufficient condition for guaranteed stability, which may be far from ne- 
cessity. In this sense, the mean square stability is easier to tackle than the guaranteed 
stability. 

It follows from Theorem 3.3 that any mean square stable system is also struc- 
turally mean square stable, as stated in the following corollary. 

Corollary 3.9 For any mean square stable jump linear system (A, V), there exist 
positive real numbers e\ and €2 such that any perturbed jump linear system (A, tf') 
is mean square stable when ||A — A|| < e\ and \\W — W\\ < 62- 

Example 3.10 For the third-order jump linear system with two subsystems 
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and transition probability 



& = 



■1 1 



it is clear that the first subsystem is marginally stable while the second is unstable. 
Routine calculation gives 



A = diag(Ai 8 At, Ai © A 2 ) + V I 
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which can be verified to be a Hurwitz matrix. According to Theorem 3.3, the jump 
linear system is mean square stable. On the other hand, under the natural basis, the 
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Lyapunov operator T can be computed to be 
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which can also be verified to be Hurwitz. It is clear that A is of eighteenth order, 
while T is of twelfth order. Therefore, the latter is more convenient in calculating 
and expressing. An interesting observation is that all eigenvalues of T are also of A, 
and they admit a common largest real part. Another interesting point is to calculate 
the transition probability set that makes the jump linear system stable. For this, 
define the region 



Q 



G Ri : <P 



, (Ai, A2, V) is mean square stable 



Figure 3.1 depicts the region within [0,20] x [0,20]. It is a little surprising 
that, though neither subsystem is exponentially stable, the region of stable transi- 
tion probabilities looks larger than unstable transition probability region. 

The next theorem shows that the mean square stability implies almost sure sta- 
bility. 

Theorem 3.11 Any mean square stable jump linear system is almost surely stable. 

Proof Suppose that the system is exponentially mean square stable. Then, there are 
positive real numbers a and /3 such that 

E p {\\0(t,O,w)\\ 2 }<Pe- c,t . 
Let r] = lim sup t _,. +00 || (k, 0, a>) \\ . It can be seen that, for any e > 0, we have 

Pr{77>e} = Pr Q [J { \\ 4> (k, 0, co) fl >e} 



j>0k>j 



< lim Pr 

7^+00 



|J{|0(A:,O, W )|> e }] 
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Fig. 3.1 Stable transition probability region 



< lim VPr{||<Z>(fc, 0,£w)|| > e} 
j^+oof— '. 

k=J 

< lim y^rEJ\\<P(k,0,co)\\ 2 } 

k=J 
, +oo 

< -r lim 1 ppe- ak =0. 



As a result, Pr{rj — 0} = 1, and the theorem follows. □ 

According to the theorem, almost sure stability is weaker than mean square sta- 
bility. Therefore, the mean square stability criteria in Theorem 3.3 provide sufficient 
conditions for almost sure stability. In general, almost sure stability does not imply 
mean square stability, as illustrated by the following example. 

Example 3.12 Let us examine the first-order jump linear system with two subsys- 
tems and transition probability matrix as 



3.2 Stochastic Stability 83 

A\ —a\, A2 — 02, & 



-1 1 

1 -1 



First, applying Theorem 3.3 yields the following mean square stability conditions: 
ai+02<l, ai+a2<2a\a2- 

The stability region in terms of a\ and 02 is depicted in Fig. 3.2. 

Next, note that, for almost sure stability, the unique stationary distribution is 
(j, 5). The state solution can be expressed by 

0(f,JE O ,ftO = e a " 1+a2 ' 2 xo, 

where t\ and ?2 are the lengths of durations over [0, t] at the first and second sub- 
systems, respectively. Applying the law of large numbers, we have 

t\ t 2 1 

lim — = lim — = — a.s. 

t^+oc t t^+oc t 2 

It follows that 

lim \<b(t, Jto, &0l = a.s. 
when «i + A2 < 0. When a\ + «2 = 0, it can be shown that 



Pr! lim sup|</>(f, fo,<w)| =o[ >0. 

lr^+oo f>T ' J 



The above reasonale shows that the system is almost surely stable iff a\ +02 < 0. 
It is clear from Fig. 3.2 that the stability region is larger than that of mean square 
stability. 

The example exhibits that mean square stability can be more conservative than 
almost sure stability, even for scalar systems. In practical applications, almost sure 
stability is more interesting as it means that the sample state trajectory is convergent 
almost surely. For scalar systems, using similar techniques as in the example, it can 
be proven that almost sure stability is equivalent to 

P\A\ + p 2 A 2 H h p m A m < 0, 

where [pi , . . . , p m ] T is an invariant distribution. As a result, the linear convex com- 
bination w.r.t. the stationary distribution is stable. Recall that the condition is also 
equivalent to the existence of a (high-frequency) periodic (deterministic) switching 
signal that drives the system stable in the deterministic sense. This means that, for 
scalar switched systems, guaranteed stability is equivalent to almost sure stability 
w.r.t. arbitrary probability transition. For higher-order systems, the above equiva- 
lences still hold when the subsystems are simultaneously triangularizable, that is, 
the subsystem matrices are upper triangular w.r.t. a common coordinate change. For 
more discussion on this issue, the reader is referred to [70, 239]. 



84 



3 Constrained Switching 



3- 



<o 0- 



-3- 



almost sure stability >v 




mean square stability 

i i i i i 


i i i i \ 




a. 



Fig. 3.2 Almost sure stability region vs mean square stability region 



To further address almost sure stability, we need to introduce the concept of top 
Lyapunov exponent, which is well known in the mathematics and control literature. 

Definition 3.13 For any p e E , the top Lyapunov exponent is defined to be 

In |</>(?; x, w)\ 
X p (u>)— limsup . (3.23) 

t-*+oo,\x\ = \ t 

It is clear that the top Lyapunov exponent is well defined and bounded: 

— max{||Ai ||, ... , ||A m ||} < X p (a>) < max{||Ai ||, . . . , ||A m ||}. 

It captures the rate of divergence (or convergence) of the state trajectory. To be more 
precise, for any positive real e, there is a positive real 8 such that 

\<j>(t;x,ai)\<8e a '> ( - a ' )+ * )t \x\ V? > 0, xeR n . 

While the top Lyapunov exponent is a random variable, it is proved to be almost 
surely a constant [189], as summarized in the following lemma. 
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Lemma 3.14 (1) For any p e E, 

k — lim E o \ln\\0(t, 0, cw)||] =k a.s. 

(2) k=- lim -E»{\n\\&(t k ,0)\\}, 

where = ?o < 1 1 < ■ • • w f ^ e switching time sequence with respect to the invari- 
ant transition p, d — lim^+oo %, and & and @(t k , 0) are as in (3.3) and (3.4), 
respectively. 

Definition 3.15 The jump linear system is said to be exponentially almost surely 
stable if there exists a positive real number p such that for any initial state with unit 
norm and initial distribution of a{t), we have 



Pr 



lim sup < — p, \ = 1. 



It is clear that exponential almost sure stability implies (asymptotic) almost sure 
stability. It is not clear whether the converse is true. That is, whether asymptotic 
almost sure stability implies exponential almost sure stability or not is still an open 
problem. Also it can be seen that exponential almost sure stability is equivalent to 
X<0. 

The following theorem presents a necessary and sufficient condition for expo- 
nential almost sure stability with the help of Lemma 3.14. 

Theorem 3.16 The jump linear system is exponentially almost surely stable if and 
only if E$ { || <P (tft , 0) || } < 1 for some natural number N . 

Proof Suppose that the system is exponentially almost surely stable. Then, the top 
Lyapunov exponent X < 0. It follows from Lemma 3.14 that 

lim £V{ln||4Hfc,0)||] < 0. 

k^+oo l " " J 

As a result, there is a natural number N such that E$ { || <t> (tpj , 0) || } < 1 . 
Conversely, the existence of such N implies that 

Vr = ^{m|4H^,0)|}<0. 

For an arbitrarily given natural number k, there exist integers p\ and p2 with 
< P2 < N — 1 such that k — p,\N + P2- We have 

l.i, in 1 r li in 

-E & {ln\\<P(t k ,0)\\}< — — — E»{ln\\0(t lxlN+IJ . 1 ,t mN )\\} 

+ ^^^{EHI*(^.'C/-iwr)|} 
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1 






£'i > {ln||$(f AtlA r +At2 ,^ lA r)||} 



H1N + H2' 
where the last equality follows from stationarity. It can be seen that, as /xj — >• +00, 

A < -J- < 0, (3.24) 

dN 

which implies that the system is exponentially almost surely stable. □ 

Remark 3.17 While the theorem is not generally verifiable, it reveals an essential 
property for exponential almost sure stability. Indeed, a system is exponentially al- 
most surely stable only if the state transition matrix is norm contractive within a 
finite number of switches. On the other hand, the norm contractility over a period 
implies that the transition matrix is also contractive over any other period with the 
same length. In this way, we can further estimate the rate of convergence in terms 
of \[r, N, and d, as showed in (3.24). 

Remark 3.18 It is interesting to compare the criterion with [216, Prop. 3], which 
provides a necessary and sufficient condition for consistent stabilizability for deter- 
ministic switched systems. By the proposition, for the deterministic switched lin- 
ear system, the state transition matrix is norm contractive within a finite number 
of switches iff the system is exponentially stable under a periodic switching signal. 
Theorem 3.16 provides a stochastic counterpart for this. However, it should be noted 
that the computation of the stochastic transition matrix is much harder than that of 
the deterministic case. 

Suppose that E§{\\0(t^ , 0)||} < 1 as in Theorem 3.16. Then, by the continuous 
dependence of the parameters, the contraction relationship still holds true even if the 
parameters are slightly perturbed. Hence we have the following robustness property. 

Corollary 3.19 For an exponentially almost surely stable jump linear system 
(A, *), there exist positive real numbers €\ and €2 such that any perturbed jump 
linear system (A, *) is exponentially almost surely stable when ||A — A|| < e\ and 

II* - *|| <6 2 . 



3.3 Piecewise Linear Systems 
3.3.1 Introduction 

Piecewise linear systems are switched linear systems with autonomous switching. 
Precisely, suppose that Q\ , . . . , Q m form a nondegenerate polytopic partition of the 



3.3 Piecewise Linear Systems 87 

state space, that is, each region £2/ is a (convex) polyhedron with nonempty interior, 
U£li &i = R", and Qi n Wj = for / ^ ,/, where J2° denotes the interior of ^2 
w.r.t. R" . Then, a piecewise linear system is mathematically described by 

x(t) = Aix(t)+ai, x{t)eQ t (3.25) 

in continuous time and by 

x(t+l) = Aix(t) + ai, x(t)eQi (3.26) 

in discrete time, where A,- e R" x ", and at e R". The systems are known as piece- 
wise affine systems in the literature due to the existence of the affine terms. When 
the affine terms vanish, the system is said to be a piecewise linear system. Here we 
abuse the notation as a piecewise system can be converted into a piecewise linear 
system via expanding the system dimension by one. Indeed, by letting 



A; 



Ai at 

c 



1, . . . , m, 



where c — in continuous time, and c = 1 in discrete time, we can reexpress the 
system as 

x + (t) = Ajx(t), x(t)eQi, (3.27) 

which is piecewise linear. 

It is clear that the evolution of the continuous state relies only on the initial con- 
figuration and is denoted by 0(f; to, xq). 

Piecewise linear systems are very important in representing and approximating 
many practical systems. First, it is a common practice that, for effectively analyzing 
and controlling a complex nonlinear dynamical system, the system is linearized 
around certain operating regions, and the linearized mode is used to approximate 
the system dynamics in the corresponding region. In this way, the original system is 
approximately represented by a piecewise linear system as a whole. Second, some 
well-known phenomena, for instance, saturations, relays, dead zones, etc., are all of 
piecewise linear forms. Third, when a linear system is controlled by state-feedback 
switching controllers, the overall system is exactly a piecewise linear system. 

A well-known problem of piecewise linear system is the well-posedness prob- 
lem caused by possible right-hand discontinuities of the system equation when the 
state crosses the boundaries. As a result, chattering may occur along the bound- 
aries, which implies that a solution in the standard sense may not always exist. The 
following example exhibits this. 

Example 3.20 For the planar two-form piecewise linear system 

[""Mx when[10]x>0, 

(3.28) 
[° Q \]x when[10]x<0, 
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it can be seen that the semi-line 

i2 + = {[0,yf:y>0} 

is a (stable) sliding mode. Therefore, for any initial state lies on the semi-line, the 
system does not admit a solution in the standard sense. 

The ill-posedness illustrates that piecewise linear systems might exhibit complex 
system behaviors. To address this issue, more general concepts of solutions, such as 
the well-known Filippov and Caratheodory definitions, should be exploited. For the 
above example, it can be seen that the system is always well-posed by Filippov's 
definition, that is, it admits a unique Filippov solution over [0, +oo) for any initial 
state. However, it can be proven that the system is not well-posed by Caratheodory's 
definition. Furthermore, if we replace A\ in (3.28) by [ ^ ~ ], then the system is ill- 
posed by either definition, due to the fact that it admits no Caratheodory solution 
for initial states on the semi-line Q + , and it admits more than one (in fact, infinitely 
many) Filippov solution on Q + . 

In this section, we present several approaches for analyzing stability of general 
piecewise linear systems, including the piecewise quadratic Lyapunov approach, the 
surface Lyapunov approach, and the transition graph approach. In the last subsection 
we focus on stability analysis of piecewise conic systems. To avoid ill-posedness, 
we assume that the right-hand side is always continuous over the boundaries. Under 
this assumption, we further assume without loss of generality that partition cells Q\ 
are closed polyhedra. To guarantee that the origin is an equilibrium, we assume that 
a.j — when e Q, ■ . For notational convenience, we divide the index set M into Mi 
and M2 such that i e Mi iff G Q\ ■■. 



3.3.2 Piecewise Quadratic Lyapunov Function Approach 

Note that, piecewise linear systems with origin equilibrium are locally (around the 
origin) piecewise linear with autonomous switching. As a result, any sufficient con- 
dition for guaranteed stability is also sufficient for the autonomous stability. In par- 
ticular, if the subsystems admit a common quadratic Lyapunov function, then the 
system is autonomously stable. While many stability criteria were given by exploit- 
ing this idea, the criteria are doomed to be conservative in general. A less conser- 
vative idea is to exploit the piecewise quadratic Lyapunov functions, which result 
in bilinear matrix inequalities or even linear matrix inequalities that are efficiently 
solvable numerically, as discussed below. 

A piecewise quadratic Lyapunov function for the piecewise linear system is of 
the form 

V(x)=x T PiX + 2qiX + ri = x T Px, xeQ u (3.29) 

where x — [*], P, — [ ' q > ]. When e J2,-, we require that q, — and r\ — 0, 
which means that V(x) — x T P t x for xefl;. For consistency, we also redefine x to 
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be [x T , 0] T when i e Mi. To apply the Lyapunov approach, we need to figure out 
the continuity of the function over the cell boundaries and the definite positiveness 
of the function. 

Fix a natural number k. Let Fi eR '° +1 ', i = 1, . . . , m, be a sequence of ma- 
trices. The matrix sequence is said to be a continuity matrix sequence w.r.t. the 
partition sequence Qi , . . . , Q m if 

Fix = Fjx Vx e Qj fl Qj, i ^ j. 

Similarly, let £, e r*x(«+1) ) / _ 1 ; _^ m be a sequence of matrices. The ma- 
trix sequence is said to be polyhedral cell bounding w.r.t. the partition sequence 
£2\, ,,. , £2 m if 

Eix>0 Vxetii. 

Lemma 3.21 Suppose that Fj, i — 1, . . . ,m, is a continuity matrix sequence. Then, 
for any symmetric matrix T e R , the piecewise quadratic scalar function V in 
(3.29) with Pj = FjTFi is continuous everywhere. Moreover, there exist real num- 
bers Pi and ji 2 such that 

Pix t x< V(x)<fJ 2 x T x. 

Proof The continuity of V follows straightforwardly from the continuity of Fjx 
over the cell boundaries. For the latter part, note that 

X min (Pj)x T x < V(x) < X ma x(Pi)x T x Vx e Qi 

when i e Mi and 

Vin(A)ro"ix r x < V(x) < X m - dx (Pi)uT2X 7 x Vx e Q-, 

when i e M 2 , where zui = 1 + — r-r ftt, and m 2 = 1 + min < s g n (Wfi)).0} . This 

clearly leads to the conclusion due to the finiteness of the index set. □ 

Lemma 3.22 Let E{ — [Ej, e{\, i — I, ... ,m, be a polyhedral cell bounding matrix 
sequence. Suppose that symmetric matrices W\ , . . ■ , W m G R + x satisfy 

Pi- EfWiEi>0, ieMi, 
Pi-EjWjEi >0, ieM 2 . 
Then, there is a > such that the piecewise quadratic function V satisfies 

V(x)>ax T x VieR". 

Proof Note that 

x T Pjx >0 Vxefi,-, x^O 
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yT p. y 

for i e My. Clearly the function - T '~ is radially constant and continuous every- 
where in Qi except possibly at the origin. Due to the closedness of cells, we have 

•^° X T PiX 

min — = — > 0, i e M\. 
xeQj x 1 x 

The same argument also holds for i G M2. The conclusion follows from the finite- 
ness of the index set. □ 

With the help of the above lemmas, we are ready to prove the main result on 
piecewise quadratic stability. 

Theorem 3.23 Let k be a natural number, E, — [Ef, e(\ and Fj — [Ft, /;], i — 
1, ... ,m, be polyhedral cell bounding matrix sequence and continuity matrix se- 
quence, respectively, and T , U{, Wi be symmetric matrices with T eR ,Uj,Wi € 
R_l_ x , i — 1, . . . ,m. Suppose that 



Pi = F?TFi, ieMi, 
P i = F7TFi, ieM 2 , 



satisfy 



and 



AfP i + P i A i + ETUiE i <0, 

ieMi, (3.30) 

Pi -EjWjEj >0, 



AfPi + PiAt+EfUiEiKO, 

- - T - ieM 2 . (3.31) 

Pi -EjWjE) >0, 

Then, the piecewise linear system is globally exponentially stable. 

Proof It follows straightforwardly from Lemmas 3.21 and 3.22 that the function V 
is continuous everywhere, ax T x < V(x) < fix 7 x for some positive real numbers a 
and f>, and V < —yx T x almost everywhere for some y > 0. As a result, the system 
is globally exponentially stable. □ 

Remark 3.24 The main advantages of the piecewise quadratic Lyapunov function 
approach include: (1) the criterion is much less conservative than the existence of 
a common quadratic Lyapunov function; (2) the searching of piecewise quadratic 
Lyapunov function is reduced to a set of linear matrix inequalities (LMIs), which 
admits efficient numerical verification [46] ; and (3) software packages are available 
for the searching of a piecewise quadratic Lyapunov function numerically, see, e.g., 
[100]. However, to find qualified piecewise quadratic Lyapunov functions, we usu- 
ally need to further partition the cells, which makes the computation inefficient for 
higher-dimensional systems. 
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Example 3.25 For the two-form piecewise linear system 



A\x whenxiX2>0, 
A2X when X1X2 < 0, 
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with 



Ai = 



-4.6 

-5.5 



5.5 
4.4 



A 2 = 



4.4 

-5.5 



5.5 
-4.6 



it can be verified that both subsystems are stable. While the cones {x : x\x 2 > 0} 
and {x : x\x% < 0} are not convex, each is the union of two quadrants. Therefore, 
let A3 = At, A4 — A2, and let £2/ be the r'th quadrant for i — I, ... ,4. Rewrite the 
piecewise linear system as 



/\.{X j A fc iJi; 



(3.32) 



As all the subsystem phase portraits are rotating clockwise, the system is always 
well defined, though the right side is not continuous over the boundaries. To apply 
Theorem 3.23, choose the continuity matrix sequence to be 



F\ — —Ft, = h, 



F 2 = -F 4 = 



-1 
1 



and polyhedral cell bounding matrix sequence to be 



Ei 



Ft 
h 



1 = 1 4. 



Furthermore, let 



T = 



1.1 -0.9 

-0.9 1.1 







Ui = 0, 



IV,- =0, i = l, 



A. 



Then, it can be verified that the conditions of Theorem 3.23 are satisfied. As a re- 
sult, the piecewise linear system is exponentially stable, and a piecewise quadratic 
Lyapunov function is 

J 



V(x) = 



Pjx, x e f2j, 



r 1.1 0.9] 
Lo.9 1.1 J" 



with P 1 = P 3 = [ _-; 9 -yj and P 2 = Pa •■ 

Figure 3.3 depicts the phase portrait of the state trajectory and the level set of the 
Lyapunov function. The flower-like trajectory indicates that there does not exist a 
quadratic Lyapunov function whose level sets are invariant. In fact, it can be veri- 
fied that the convex combination 0.4Ai + O.6A2 has an eigenvalue with positive 
real part. As a result, the switched system does not admit any common quadratic 
Lyapunov function [205]. 
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Fig. 3.3 Phase portrait (solid) and level set (dashed) 



3.3.3 Surface Lyapunov Approach 



While the piecewise quadratic Lyapunov approach introduced in the previous sub- 
section provides much less conservative criteria than the conventional quadratic 
Lyapunov approach, the approach may admit very heavy computational load. In- 
deed, for many piecewise linear systems, it is necessary to seek more refined parti- 
tions (than the natural partitions) so that a valid piecewise quadratic function could 
be found. For continuous-time piecewise linear systems, any state trajectory has to 
cross cell boundaries or otherwise stay within a cell forever. It is thus heuristic to an- 
alyze the stability through the system dynamics across the switching surfaces. This 
is clearly illustrated by the following example. 



Example 3.26 For the continuous-time two-form piecewise linear system 

[i'i_ 3 i]* if*i<0, 



(3.33) 



it is clear that the first subsystem is unstable. Therefore, the piecewise system does 
not admit any global Lyapunov function, nor it admits any piecewise quadratic Lya- 
punov function w.r.t. the natural cell partition (cf. [100]). However, the system is 
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Fig. 3.4 Phase portrait (left) and transition map (right) 

exponentially stable, as illustrated from the phase portrait (the left of Fig. 3.4). In 
fact, starting from the unit vector zo — [0 l] T on X2-axis, the state comes back to the 
axis at z\ ^ [0 — 0.62] r and Z2 ^ [0 0.69] r . It is clear that the map at the switching 
surface (from zo to Z2) over a period is contractive w.r.t. the Euclidean norm, which 
is shown on the right of Fig. 3.4. The exponential convergence follows from the 
homogeneity of the switched system. 

The example indicates a way to analyze the stability of piecewise linear systems 
through the contractility of surface (impact) maps, which are defined on the switch- 
ing surfaces instead of the total state space. More accurately, if each map from one 
switching surface to another is contractive w.r.t. an energy function, the piecewise 
linear system is stable if no unstable state trajectory exists within a cell. In this way, 
the searching of a Lyapunov function is reduced to the searching of a surface Lya- 
punov function, which is required to decrease along the impact maps. The major 
steps toward the approach include the computation of the impact maps over possi- 
ble switching transitions and the searching of a proper surface Lyapunov function 
for the impact maps. Let us define the impact maps first. 

Consider the affine linear system given by 



x = Ax + B, 



(3.34) 
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where x e R n , A e R nxn , and BeR". Suppose that the system is defined over a 
polyhedron X C R" and that So and S\ are two hyperplanes in the boundary of X 
with 

S = jx€R": C x = d }, 5 X = [x e R" : Cue = d{\, 

where Co, Ci, and do, d\ are matrices and column vectors with compatible dimen- 
sions. Let X be the closure of X, Sq be a polytopic subset of So with the prop- 
erty that any trajectory x(-) starting at Sq satisfies x(t\) e S\ for some time t\ and 
x(t) £ X for ? e [0, fi], and S" be the subset of Si which is the collection of the 
above x(?i)'s. The impact map from Sq to S" is the map from xq — x(0) € Sq to 
xi = x{t\) e S" through the state trajectory x(-). Note that the map is not neces- 
sarily injective. Indeed, when a state trajectory starting from So reaches S\ more 
than once within region X, there is a sequence of time constants t\ < ?2 < ■ ■ ■ < t\, 
k > 2, such that x(tj) e S\, j = 1, . . . , k, and x(t) e X for t e [0, t k ]. As a result, 
the impact map may be multivalued and discontinuous. 

Suppose that Xq and xj* are two states belonging to the hyperplanes So and Si, 
respectively. A state xq in Sq can be parameterized by xq — Xq + Aq with Co^o = 0. 
Similarly, a state xi in Sf can be parameterized by xi — x* + Ai with CiAi =0. 
In this way, the impact map from xo to xi reduces to the map from Ao to Ai. Let 
x(t\ xo) be the state trajectory with initial state x(0) = xq, and by jc (?) and x l (t) 
we shortly denote x(t; Xq) and x(t; x*), respectively. 

Definition 3.27 Let xq — Xq + Ao e Sq . Define the set of switching times of the 
impact map at Ao to be 

t Ao = jseR + :x(s) e Si,x(t;xo) eXVt e [0,s]}. 

Define the set of switching times of the impact map over Sq — Xq to be 



T= |J t A . 



AsSS-x, 



^0 



In general, the sets of switching times may be unbounded, and it is hard to express 
the sets in a closed form. However, by defining the functions 

Cie At 

u>(0 = 



di - Cuc°(?) 
and 

H(t) = e At + (x°(t)-x* l )w(t), 
the impact map can be characterized as follows. 
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Theorem 3.28 Assume that C\x°(t) ^ for t e T . Then, for any A e S' { 
there exists t e T such that the impact map is given by 

A 1 =H(t)A Q . (3.35) 

Proof Suppose that xq — Xg + Aq e Sq and xi — x* + A[ e S". Integrating the 
system equation (3.34) yields 



f 'e A( '-*h 
Jo 



x l =e /u x Q + / e^'- z >Bdr 



for some t eT. This further implies that 



A l ^e At A + x°(t)-x* l . (3.36) 



On the other hand, it follows from C\A\ =0 and C\x\ — d\ that 

Cie At A Q = di-Cix Q (t), 

which leads to 

w(t)A = h (3.37) 

Combining (3.36) with (3.37) yields 

4l = e At A + (x°(t) - x*)w(t)A , 

which is exactly (3.35). D 

Remark 3.29 The theorem asserts that the impact map from Aq to A i is linear, pro- 
vided that the switching time is fixed. To utilize this fact, it is necessary to examine 
the submanifold of Sq that corresponds to the same switching time. For a time t eT, 
let S t be the set of states x^ + Ao with t e tA Q ■ It is clear that S t is nonempty and 
that Urer $t — Sq. Furthermore, as w(t)Ao — 1 and CoZ\rj = 0, S t is a subset of a 
linear manifold of dimension n — 1. 

Based on the above preparations, we are ready to introduce the surface Lyapunov 
functions for analyzing the global asymptotic stability of piecewise linear systems. 
Let Vo and V\ be two smooth positive definite functions defined over Sq — x^ and 
S" —x*, respectively. Clearly, if 

Vi(Ai)<V (Ao) VAoeSt-x*, (3.38) 

then the impact map from Sq to S" is a contraction. In this case, Vo and V\ are 
called surface Lyapunov functions defined over Sq and S", respectively. Usually, it 
is very hard to verify the contractility for general surface Lyapunov functions due 
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to the nonlinear nature of the impact map. So we restrict our attention to piecewise 
quadratic surface Lyapunov functions of the form 

Vi{x)=x T Pix-2gjx + ai, i=0, 1, (3.39) 

where < P, e R" x ", g, e R", and a, e R, i = 0, 1. For a symmetric matrix M e 
R" x " and a region F C R", by M > on F we mean x T Mx > for any ^ x e F. 

Theorem 3.30 Suppose that Vj, i = 0, 1, are piecewise quadratic surface Lyapunov 
functions as in (3.39) flnrf define 

R(t) = P - H T (t)PiH(t) - 2(g - H T (t)gi)w(t) + w T (t)aw(t), (3.40) 

where a = ao — a\. Then, inequality (3.38) holds iff R(t) > on S t — x^ for all 
teT. 

Proof Rewrite (3.38) as 

A\PiAi - 2g\A x +a x < A^PoAo - 2g^A + a . 
Applying Theorem 3.28 gives 

Al(P - H T (t)P!H(t))Ao - 2(gl - gjH(t))A Q + u> 0. 
Utilizing the fact that w{t)Ao — 1, we obtain 

AZ(P - H T (t)P x H(t) - 2w T (t)(gl - gjH(t)) + w T (t)aw(t))A > 0, 
which verifies the theorem. □ 

Corollary 3.31 The impact map from Sq — Xg to S" — x* is a contraction if there 
exist Pq, P\ > and go, g\ , a such that R(t) > on S t — x^ for all teT. 

This corollary provides a criterion for contractility of the impact map. However, 
the computation of the manifold S t is usually untractable. One way to cope with this 
difficulty is to further relax the condition as follows. 

Corollary 3.32 The impact map from Si — Xq to S" — x* is a contraction if there 
exist Pq, Pi > and go, g\ , a such that 

R(t) > on S - xq* Vf e T. (3.41) 

Condition (3.41) is an infinite set of linear matrix inequalities (LMIs). Compu- 
tationally, the set should be gridded into a finite subset of LMIs, which can be effi- 
ciently solved using available softwares. More details could be found in [92, 93]. 

To summarize, for a piecewise linear system, the main steps toward global 
asymptotic stability analysis include: (1) identifying all impact maps associated 
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with the piecewise linear system; (2) defining all surface quadratic functions on 
the respective domains of impact maps; and (3) adjusting the parameters of the sur- 
face Lyapunov function so that condition (3.41) holds. In contrast to the piecewise 
quadratic Lyapunov function approach introduced in the previous subsection, the 
surface Lyapunov approach has several advantages including: (1) the analysis is 
based on the original cell partition, and no refinement of the partition is needed, and 
thus the computational burden is usually much lower; (2) the approach scales better 
with the dimension of the system due to the fact that the Lyapunov function is only 
needed to be sought on the switching surfaces instead of the total state space; and 
(3) the approach can prove global asymptotic stability, while the piecewise quadratic 
Lyapunov function approach can only prove exponential stability. However, it is 
clear that the approach applies only to continuous-time systems, while the piecewise 
quadratic Lyapunov function approach applies to both continuous- and discrete-time 
systems. Besides, the identification of impact maps is usually not an easy task, es- 
pecially when there are three or more switching surfaces. 

Next, we apply the above analysis approach to a class of saturated systems. 
A single-input single-output linear system with a saturated unitary output feedback 
could be described by 

x — Ax + bu, 

y = c T x, (3.42) 

u — sat(y), 

where sat(-) is the standard saturation function 



sat (y) = 



-1 ify<-l, 

y if|y|<i, 

1 ify>l. 



Note that the saturated system always admits a unique solution due to the fact that 
Ax + b sat (c T x) is globally Lipschitz continuous. 
It is clear that there are two switching surfaces, i.e., 



and 



^..^_ 1) 



S" = |ieR*:c T i = -l] 



The surfaces are origin-symmetric and separated. Denote A\ — A + bc T . To ensure 
that the origin is the unique equilibrium with local stability, we must have that A\ 
is Hurwitz, and A does not admit any eigenvalue with positive real part. Besides, 
when A is nonsingular, it must satisfy —c T A~ l b < 1. Define 

S+ = {x e S + : J A x x > 0}, ^ = {ieX + : c T A x x < 0} 

and 

S; = )«r: c 7 ' A\x > 0}, SZ = {x € S~ : c T A lX < 0}. 
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As Aj is Hurwitz, there exists a nonempty subset of ST. denoted S*, such that any 
state trajectory starting from S* will not switch again and will converge to the origin 
asymptotically. To see this , let P > be a solution of A^ P + PAi — — I, and define 
tu — max r rp t _| c T x; then the intersection S + fl {x : x T Px — uj 2 } is inside S*. It 
can be seen that the subset S* is a convex and closed subset of S^ . 

Taking advantage of the origin-symmetry of S + and S~ , we need to take care of 
three impact maps: (1) the map from S+ to ST; (2) the map from SZ — S* to S±; 
and (3) the map from SZ — S* to SZ. Let 7\, T 2 , Tj denote the sets of the switching 
times for the impact maps, respectively. For a state trajectory starting from xo e S+ , 
it switches at x\ e ST. If x\ e S*, then the trajectory converges to the origin without 
any further switching. Otherwise, x\ e ST — S*, and it may switch at either X2 a e S^ 
or X2b e S~. The next switching occurs at xj, a e S_ and X34, e SZ, respectively. The 
idea is to check whether sequence x\ , xj, a / — x^, ... is contractive with respect 
to a quadratic surface Lyapunov function. If so, then the sequence will eventually 
enter into set S*, and global asymptotic stability of the piecewise linear system is 
established. 

Choose x\ = P~ l c/(c T P~ l c) e S*, where P > satisfies A[ P + PAi = -/. 
Xq e S^T can be chosen similarly in a subtler manner. Let x°(-) and x 1 (■) be the state 
trajectories starting from Xq and xjf, respectively. 

Define the functions 

wi(t) = c T e A, /(l - c T x°(t)), w 2 (t) = c T e Al '/(l - c T x l {tj), 

w 3 (t) = c T e At '/(-l - c T x l (t)), 
and further the impact maps 

Hi(t) = e At + (x°(f) - x*)wi(t), H 2 (t) = e Alt + (x J (f) - x*)w 2 (t), 

H 3 (t)=e Alt + (x 1 (t)+x$)w 3 (t). 

By applying Corollary 3.32, we have the following stability criterion for saturated 

systems. 

Proposition 3.33 Saturated system (3.42) is globally asymptotically stable if there 
exist matrices P\, P 2 > 0, vectors gi and g 2 , and a real number a such that the 
inequalities 

Pi - H[(t)P 2 Hi(t) - 2(gi - H[(t)g 2 ) Wi (t) + < (t)awi(t) > on S+ - x*, 
P 2 - // 2 r (r)A//2(0 - 2(g 2 - Hi \t)gi)w 2 (t) + wl(t)aw 2 (t) > on S+ - x*, 
P 2 - H[(t)PiH 3 (t) - 2(g 2 - HT(t) gl )w 3 (t) + wT(t)aw 3 (t) > on S+ - x* 

hold for t e T\, t ET 2 , and T G T-$, respectively. 

Finally, we present a numerical example to illustrate the effectiveness of the sur- 
face Lyapunov function approach for saturated systems. 
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Example 3.34 For the planar linear system with saturated output feedback 



X — 


"-1 0" 

. o 0_ 


x + 


2 
. "0.4 . 


y = [0.6 l]x, 




U — l 


-at(y), 







(3.43) 



it is clear that the system is locally stable at the origin equilibrium. An ele- 
mentary analysis shows that any state trajectory starting from the saturated area 
(|c r x(0)| > 1) crosses the switching surfaces. There are three impact maps: the 
map from S+ to S*, the map from SZ — S* to SZ, and the map from SZ to — S*, 
which is symmetric to the first map. Note that any state trajectory starting from the 
switching surfaces enters into ±5* by two or less switches. As any state trajectory 
starting from ±S* asymptotically converges to the origin, global asymptotic stabil- 
ity is guaranteed. Figures 3.5 and 3.6 show sample phase portraits starting from S + 
and the corresponding impact maps, respectively. In this simple case, no explicit 
surface Lyapunov function is needed for stability analysis. 

An interesting point here is that the system is not globally exponentially stable. 
Indeed, let x(t; xq) be the state trajectory with x$ — [a 1 — 0.6a] T e S + , where a is 




Fig. 3.5 Sample phase portraits 
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Fig. 3.6 Illustration of impact maps 

a real parameter. Furthermore, let t\ be the first switching time with x(t\\ xq) e S + . 
Then, it can be shown that 

lim — = — , 

which excludes the possibility of global exponential stability of the piecewise linear 
system. This means that the piecewise Lyapunov function approach does not apply 
to the system. 



3.3.4 Transition Analysis: A Graphic Approach 



An intrinsic difficulty of stability analysis for piecewise linear systems lies in the 
fact that switching transitions among the cells are autonomous. Therefore, the au- 
tonomous stability is neither robust as in guaranteed stability nor flexible as in stabi- 
lizing switching design. The lack of both robustness and flexibility in the switching 
mechanism makes autonomous stability very hard to understand. 

In this subsection, rather than taking the autonomous switching as a negative 
factor, we try to take advantage of the switching transitions and present a graphic 
approach for autonomous stability analysis. 
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Definition 3.35 Discrete state i e M is said to be weakly transitive if for all xq e 
Qi — {0}, we have either 

3f>0, (p(t;0,x )gni 



Vr>0, <f)(t;0,XQ)e£2i, lim <j>(t; 0,xq) = 0. 

r-»+oo 

It is clear that, when & Qi , then state i is weakly transitive if for all xq e £?,- , 
there exists t > such that (p(f, 0, Jto) & &i- That is to say, there does not exist a 
whole (continuous) state trajectory that stays within the cell. In this case, state i is 
said to be transitive. Another observation is that a necessary condition for global 
asymptotic stability of the origin is the weak transitivity of all discrete states. 

Based on the transitive relationship, we could formulate a graphic approach for 
addressing the stability of the piecewise linear system. 

Let (V, 3) be a directed graph with V — M being the node set, (i, j) € 3 if 
i 7^ j, and there exist a state xo € J2, and a time / > such that 4>{t; 0, xq) e Qj. 
When (;', j) e 3, (i, j) is said to be an edge of the graph, and 3 is the edge set. For 
a node i , its neighbor set is 

7} = {jeV:(i,7)eS}. 

Definition 3.36 A collection of nodes Vo C V is said to be invariant if r, C Vq for 
all i e V Q . 

As a trivial fact, the node set V itself is invariant. 

Definition 3.37 A collection of nodes Vo C V is said to be attractive if it is invariant 
and the set V — Vq does not contain any loop. 

It is clear that, a node set is attractive if each path with sufficiently large length 
contains a node in this set and all the successive nodes stay in the set forever. 

An attractive set is said to be minimal if any strict subset is not attractive. A min- 
imal set is denoted Vmi n . 

For the piecewise linear system, any invariant node set Vo C V induces a subdy- 
namics described by 

x + (t) — Afx + at, xe£2i,ieV (3.44) 

whose dynamics is part of that of the original system, and the stability is simpler 
to analyze. For simplicity, system (3.44) is denoted by Vb-induced piecewise linear 
system. 

Theorem 3.38 The piecewise linear system is globally asymptotically stable if the 
following conditions hold: 
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(1) each discrete state is weakly transitive 

(2) there is an index i e M such that e £2° and i e V m ; n , and 

(3) the Vmm-induced system is globally asymptotically stable 

Proof The proof is straightforward. Any state trajectory either converges to the ori- 
gin without going through the region U/sv ®i ^ ue t0 me wea k transitivity or 
enters into the region in a finite time and then converges to the origin within the 
region. □ 

Remark 3.39 The merits of the theorem include simplifying the stability verifica- 
tion with the aid of graphic decomposition and applying to both discrete-time and 
continuous-time systems. More importantly, the graphic approach provides an effec- 
tive method for attractivity analysis. Indeed, when Vo is attractive, then UieVb ^' * s 
an invariant domain. 

Example 3.40 H-K model of opinion dynamics. 

Krause-Hegselmann [103] proposed a model of opinion dynamics with a uni- 
form confident level, which is mathematically described by 

I '( ( + 1 ) = ^E I 'W' i = l,...,K, (3.45) 

where x; e R is the opinion value of agent i , x — [xi , . . . , x K ] T , r is the level of con- 
fidence, Ni is the neighbor set of agent i defined by Ni (t) — {j : \xj (t) — x, (t) \ < r], 
and | Ni \ denotes the cardinality of set A^, . The model is called K-H model or H-K 
model in the literature. 

The problem of asymptotic consensus is to determine the region of initial states 
that lead the agents' opinions to a common value. For this, define the region 

X^fxoeR": lim (xi(t,xo) -Xj(t,x )) = Vi^/1, (3.46) 

where x; (t , xo) denotes the state x; at time t with initial condition x, (0) = xo, . It has 
been established in [103] that any consensus process is finite-time convergent, that 

is, 

X((t, xo) = Xj(t, xo) Vz' ^ j, xo € X, t >T, 

where T is a natural number that relies on k. From this and from the complete 
orderedness of the opinions we can further prove that each process reaches its final 
dynamics in a finite time, that is, there is a natural number T* such that 

xt {t + T*, x ) = xi (T*, xo) Vr e T , x e R" . 

As a result, the limit in (3.46) always exists. Furthermore, when x,(0) < x ; (0), 
then we have x,(r) < Xj(t) for all t > 0. As a result, the order of the opin- 
ion values always keeps unchanged. Without loss of generality, we assume that 
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x\ < X2 < ■ ■ ■ < x K . Another useful observation is that if Xj+i(t) — x,(f) > r for 
some i and t , then the inequality holds for all forward time. Therefore, a necessary 
condition for consensus is 

x i+ i(t)-Xi(t)<r, Vi = l,...,K-l,teT . (3.47) 

To apply the graphic approach, one way is to redefine the state vector that takes 
Xt — xj as elements, and the consensus problem reduces to the attractivity of the 
piecewise linear system. However, for the sake of simplicity, here we still use x as 
the state vector, and the graphic approach is utilized in a heuristic manner. 

First, define 

Xi = {i6R r :x f -ii <r}. 

This implies that | N, ■ | — k for all i. It is clear that any opinion process initiated from 
X\ achieves consensus in one step, and any consensus process must enter into X\ 
before the final consensus is achieved. As a result, X\ C X, and X\ is the minimal 
attractive region w.r.t. X. That is to say, any other cell within X must be transitive to 
X\ in a finite time. Note that when k — 2, X — X\, and the consensus is equivalent 
to initial connectedness of the opinion dynamics network. 
Next, for k > 3, define 

Xj — \x € R K : x K — X2 < r, x K _\ — x\ < r, x K — X\ > r\. 

This corresponds to\N\\ — \N K \— k — \ and \Nj\ — k otherwise. For any x (0) e X2 , 
we have 

1 K 1 K ~ l 
x K (l,x(0))-xi(l,x(0))= 7 y>(0) 7^^.(0) 

K — 1 i — J K — 1 i — J 

j=2 i=l 



= -(x,(0)-xi(0)) 

K — 1 



2 
< r, 

~ K- 1 

which means that x(\, x(0)) e X\. That is, X2 is transitive to X\ in one step. Note 
that when k — 3, X — X\ U X2, and the consensus is equivalent to initial connect- 
edness of the opinion dynamics network. 

Then, continue the analysis process and define 

X tl — {x eR K :x K - xi { < r, x K -i 2 - x\<r, 
x K - x h -\ > r, X K -i 2+ \ -x\> r), 

where l\ — L^2 -I ' s me l ar 8 est integer less than or equal to ^~y~, and I2 — \^^~\ 
is the smallest integer larger than or equal to ^- . It can be verified that, for any 
x(0) e X/j, we have 



x K (l,x(0))-x h (l,x(0))<r 
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and 

*k(l,Jc(0))-*i(l,Jc(0))<r. 

This means that x(l,x(0)) e U/=i^/' which further implies that x(t,x(0)) e 



l£ 



.j Xj for all t e 7o. It follows from the opinion dynamics equation that both 
x K (t, x(0))— xi x (t, x(0)) andx/ 2 (f,x(0))— xi(f, x(Q)) are contractive as t increases, 
which further implies that region Xi t is transitive to X\ in a finite time. 

To summarize, the regions X%, ■ . . , X] { are transitive to Zi in a finite time, and 
any state in X\ achieves consensus in one step. By applying Theorem 3.38, we 
obtain the following consensus criterion. 

Proposition 3.41 The opinion dynamics reaches a consensus if | TV,- CO) I > ^~ far 
any i ■= 1 , . , . , k . 

While conservative, the proposition provides an easily verifiable sufficient con- 
dition, which only relies on the initial network graph. Besides, it tells us that, when 
each person in a society finds that more than half of the population (nearly) agree 
with him, then a consensus could be finally achieved. 

To illustrate the effectiveness of the above analysis, we take k — 5. Let r — 1 and 
xq = [—1, —0.9, 0, 0.9, l] T . It can be verified that the condition in Proposition 3.41 



1«r 



0.8 



0.6 



0.2 



-0.2 



-0.4 



-0.6 



-0.8 



-■\tf- 



S okh • -• z>— 

en ^^ 



/ 



0.5 1 1.5 2 2.5 3 3.5 

Time (Sec) 



Fig. 3.7 Consensus of the opinion dynamics 
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Fig. 3.8 Split of the opinion dynamics 

is satisfied. Therefore, consensus can be achieved. Figure 3.7 shows the evolution 
of the opinion dynamics, which achieves consensus in three steps. 

Finally, take the initial state to be xo = [—1, 0, 1, 1.5, 2] T . It can be verified that 
1^1(0)1 = 2, which means that the condition in Proposition 3.41 is violated. Fig- 
ure 3.8 depicts the evolution of the opinion dynamics, and it is clear that the agents 
split into two parties within two steps. 



3.3.5 Conewise Linear Systems 

A continuous function / : R" — >• R" is said to be conewise linear if there exist a 
finite set of convex polyhedral cones {X\, . .., X m ] with U"Li %i — R" ar, d n x n 
matrices {Li, . . . , L m ] such that f(x) — L,x for x e Xj. 

A conewise linear system is a differential or difference equation with a conewise 
linear function as the right-hand side: 

x + (t) = A iX , xeXi, (3.48) 

where A\ , . . . , A m are n x n real constant matrices, and {X\ , . . . , X m ] is a set of 
convex polyhedral cones with {J™ =1 X\ — R" and X° nX° = for i ± j. 
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It is clear that conewise linear systems are piecewise linear systems with conic 
state partitions and without affine terms. Other important features include that the 
system is homogeneous with degree one and that the right-hand side is globally 
Lipschitz continuous. As a result, the system always admits a unique solution over 
the time space from any initial state, and local asymptotic stability implies global 
asymptotic stability. Furthermore, we can prove the equivalence among the stability 
notions, as stated in the following proposition. 

Proposition 3.42 For the conewise linear system, the following statements are 
equivalent: 

(1) The system is attractive. 

(2) The system is asymptotically stable. 

(3) The system is exponentially stable. 

Proof We only need to prove that attractivity implies exponential stability. For this, 
suppose that the conewise system is attractive. This means that, for any state x on 
the unit sphere, there is a time t x > such that 

|0(r-O,x)|<I. 

As the vector field of the system is globally Lipschitz continuous, there is a positive 
real number r such that 

\4>(t x ; 0, x) - &(t x ; 0,y)\<^ Vv e B r (x). 

Combining the above inequalities yields 

\4>{t x ;0,y)\< 1 - VyeB,.(x). 
Letting x vary along the unit sphere, we have 

(J B r (*)DHi. 

As the unit sphere is compact, by the Finite Covering Theorem, there is a finite set 
of states xi , . . . , x; on the unit sphere such that 

/ 
(jB r (x;)DHi. 

7 = 1 

As a result, we can partition the unit sphere into / regions R\, ... , Ri such that Rj C 
B r (Xj), 7 = 1,...,/, U;-=i Rj = Hi, and R, HR k = 0Vj ^ k. Define accordingly 

Qj = {x : 3k > 0, kxe Rj}, sj =t x J, j = \,...,l. 
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For any initial state xq, define recursively 
i k — #{x e Q j], 

tk+l — tk +%, 

Zk+i = <P(tk+r, tk,Zk), k = 0,1,2 

with to — and zq — xq. It can be seen that 

z k = <Kt k ;0,x ), |z i+ i|<^, k = 0,1,2,..., 
which further implies that 

\Hf,0,xo)\<Pe- at \x \ VreTo, 
where B = e max{||A 1 ||,...,||A m ||}max{ i i, ...,*,} d = in2 Th conclusion fol . 

^ ' maxjii,...,5;( 

lows due to the arbitrariness of xq. D 

Note that the stabilities do not always coincide for general piecewise linear sys- 
tems, as exhibited by Example 3.34. 

Next, we are to present a verifiable criterion for stability of conewise linear sys- 
tems. For this, we introduce the notion of unit- sphere contractility as defined below. 

Definition 3.43 For a given norm | • |, the conewise linear system is unit-sphere 
contractive (w.r.t. norm | ■ | ) if for any state x with unit norm, there is a time T > 
such that | <p (J; Q,x)\ < 1. 

Theorem 3.44 The following statements are equivalent to each other. 

(1) The conewise linear system is exponentially stable. 

(2) The conewise linear system is unit-sphere contractive w.r.t. any given norm. 

(3) For a given norm, the conewise linear system is unit-sphere contractive. 

Proof It is clear that (1) =>■ (2) =>■ (3). So we need only to prove (3) =>■ (1). 

For any arbitrarily given but fixed state x with unit norm, let T be such that 
|0(r;O,Jc)|=jli;c < 1. Define 



T x — minjf : \<f>(t; 0, x)\ — p x ] 



By the continuous dependence of initial state, there exists an open neighborhood N x 
of x such that 

\<p(T x ;0,y)-<p(T x ;0,x)\< ~^ x VyeN x , 



which further implies that 



\<P(T x ;0,y)\<^J^ VyeN x . 
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Letting x vary along the unit sphere, it is obvious that 

U iV,2Hi. 

By the compactness of the unit sphere and the Finite Covering Theorem, there exist 
a finite number / and a set of states x\, . . . , xi on the unit sphere such that 



U^DHi. 



Accordingly, we can partition the unit sphere into I regions R\, ..., Ri such that 
Ui=l R-i = Hi. In addition, for each i, 1 < i < /, we have 

\<KT Xi ;0,y)\<^^- VyeRi. 

For any state z e R" , there are x e R, with 1 < i < I and a positive real number A 
such that z — Ajc. Denote T z — T Xi and \± — max{/x A] , . . . , /U.^}. It is clear that 

\<p(,T z ;0,z)\<^-^\z\ VzeR". (3.49) 

Then, for any xq ^ 0, define recursively the sequence of states 

zo = xo, 

z k +\=4>(Tz k ;0,zk), it = o,i,.... 

Similarly, define recursively a sequence of times 

fo = 0, 
t k+1 = t k + T Zk , fe=0,l,.... 

It follows from (3.49) that 

|</>fe;0,z)|<(^±^) |z|, *=1,2,.... (3.50) 

Finally, we prove that each state trajectory under the above switching path is 
exponentially convergent. To see this, let 

r = max7\- ; , a = ln2/r, r) =max||Aj||, /J = 2e' ? . 

( = 1 ./ = 1 

It follows that 

|0(r; 0, x )| <ySe"°"|xo| Vjc e R", t e %. (3.51) 

This completes the proof. □ 
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Next, we are to develop a constructive procedure for verifying the unit-sphere 
contractility, which by the theorem provides a computational verification of expo- 
nential stability of the conewise linear system. The idea is to select a set of states 
with unit norm and determine a neighbor of contractility for each state. When all 
the neighbors cover the unit sphere, the system is unit-sphere contractive. A key 
issue is to estimate a contractility neighbor for a given initial state. For this, denote 
L — max{||Ai ||, ..., ||A m ||} and fix a real number S e (0, 1). 

Proposition 3.45 Let x be a state with unit norm, and T x > be such that 
\4>(T X ; 0, x)\ < S. Then, for any y with \y — x\ < n x (l — S),we have 

\<j>(T x ;0,y)\<l, (3.52) 

where X) x — e * in continuous time, and r\ x — -p^ in discrete time. 

Proof Note that L is a Lipschitz constant for the conewise linear system, that is, for 
any indices i, j e {I, . . . ,m} and any states x e Xj and y e Xj, we have 

\AiX-Ajy\ <L\x-y\. 

To see this, denote the ordered set of intermediate states 

zo = x, zi, ..., Zk,Zk+i = y 

on the segment (x,y) such that (zi,Zi+\) is within some X m for each I e 
{0, 1,..., A:}. It is clear that 

\AiX-A jy \ < \Aj X - AiZi\ + ■ ■ ■ + \AjZ k - A/y\ 
<L(\x-zi\ + --- + \z k -y\) 
= L\x-y\. 



T 

T x ;0,y)-<j>(T x ;0,x)\<\x-y\ + L I \<p(t;0, y) - <j>(t; 0,x)\dt. 



This implies that, for continuous-time systems, we have 

■ \ \<t>(f, 
Jo 

It follows from the Bellman-Gronwall lemma that 

\<j>(T x ; 0, y) - <j>{T x ; 0,x)| < e LT *\y - x\, 

which leads to inequality (3.52). The discrete time case can be established in the 
same manner. □ 

Remark 3.46 The proposition presents an estimate of the radius of a ball within the 
contractility neighbor for any given state with unit norm. The radius is dependent on 
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the contractility ratio, the subsystem matrices, and the time length T x for contractil- 
ity. For any exponentially stable conewise linear system with convergence estimate 
(3.51), it can be seen that T x can be chosen such that 

In B -In S 

T x <— Vx. 

a 

This means that a uniform lower bound of the radius could be explicitly computed. 

Based on the proposition, we could outline a computational procedure for veri- 
fying the unit-sphere contractility. For this, denote the region A^ — {y : \x — y\ < 
t] x (l — 8)} for a state x. 

(1) Select a set of initial states x\ , . . . , Xk that are uniformly distributed on the unit 
sphere with a preassigned dense. 

(2) Determine the times T Xi by simulation. 

(3) Check whether Hi C U/=i Nxt or not - If Y es ' return "System is exponentially 
stable." Otherwise, double the dense of the initial states and repeat the process. 

Conceptually, the procedure does work as it terminates in a finite time when 
the system is unit-sphere contractive. However, it does not terminate when the sys- 
tem is not unit-sphere contractive. Technically, it is usually not an easy task for 
representation of a region and a union of regions, and for verification of subset re- 
lationship between two regions. In particular, region N x is norm-dependent, that is, 
different norms may correspond to different regions. Note that, for the ^2-norm, the 
region is generally nonconvex (and not a union of a finite set of convex regions) 
and nonpolyhedric as well. In this case, it is very hard to verify the subset relation 
Hi C U/=i ^Vxj • Accordingly, we use the £i-norm instead. In this case, each N x is a 
convex polytope, and the subset relationship can be verified by means of commercial 
numerical softwares (for example, MATLAB GBT Toolbox [252]). 

To further reduce the computational load, we take the reduced-order approach. 
For this, first consider the (upper) half unit sphere given by 

H| = {x= [xi,...,x n ] T : x„ >0, |x|i = l}. 

This sphere can be projected into the (n — 1) -dimensional unit ball by the map 

V n : H+ h+ B'f 1 , V n X = [*!,..., X„_if . 

The inverse map is 

V- 1 y = [yi,...,y n -i,l-\y\i] T , yeB 



n-\ 
1 • 



Define N+ = {y e H+ : \x - y\ < rj x (l - 8)} and PN+ = {P n y : y e N+] c B? -1 . 
Similar reduction can be made for the (lower) half unit sphere given by 

B.- = {x = [xi,...,x„f: x n <0, |x|i = l}. 
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The subset relation Hi C U;=i ^, i s reduced to 

U ^=b«-\ u pn-^i~\ 

which could be verified over the (n — 1) -dimensional unit ball. 
Example 3.47 For the planar discrete-time conewise linear system 
x{t +\) = Aix(t), x(t)eXt, t = 0, 1,..., 
with 



A 2 = 
A 3 = 



-1.4078 0.1223 

1.3846 0.4437 

-0.5837 -0.7019" 

0.5213 1.3070 

0.2405 0.1223^ 

-0.3420 0.4437 



X x = \x e R 2 



X 2 = \x e R 2 : 



X 3 



xeR z 



1 
1 -1 

1 1 

-1 1 

-1 
-1 -1 



x>0\, 



x>0 



x>0\, 



it can be verified that the first and the second subsystems are unstable, and the third 
one is stable. 

Set contractility rate S — 0.8, and dense size y = 0.01. Let yk = — 1 + yk, 
k — 0, 1, . . . , 2/y, which are equally distributed on the one-dimensional unit ball 
[—1, 1]. By projecting yk into the two-dimensional upper and lower half unit 
spheres, respectively, we have x^ — [yk, 1 — \yic\] T and x k — [yk, — 1 + \yic\] T for 
k — 0,1, . . . ,2/y. The next step is to determine T x by simulation for each ini- 
tial state x € {xu,xi,k — 0,1, ... ,2/y}. It was found that each initial state is 
S -contractive within three steps. Simple calculation shows that the radius of A^ 
is not less than 0.0092, which corresponds to r — 0.0065 when projected into the 
one-dimensional space. In this way, the interval (yk — r, yk + r) is a contractility 
neighbor of yk- It is clear that 

2/r 



[-1,1] <z\J{yk-r,y k +r), 



k=Q 
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-1 -0.8 -0.6 -0.4 -0.2 0.2 0.4 0.( 

Fig. 3.9 Phase portrait of the conewise linear system 



which means that the conewise linear system is exponentially stable. Figure 3.9 
depicts a sample phase portrait, which stays and converges within X2 after several 
switches between X\ and Xj,. 



3.4 Dwell-Time Switching 

For switched linear systems, it is well known that the exponential stability of the 
subsystems does not necessarily imply stability of the switched systems under arbi- 
trary switching. However, under a switching law with sufficiently large dwell time, 
the exponential stability of the subsystems does imply the asymptotic stability of 
the switched systems, due to the fact that any exponentially stable system admits 
a finite transient process. This arises an interesting problem of finding the least 
dwell time such that the switched system is globally stable under any switching 
signal with the dwell time. The problem, which we refer to the least stable dwell 
time problem, is both theoretically challenging and practical appealing. Indeed, the 
least stable dwell time is a measure of fault tolerance for systems with a nominal 
subsystem and a substitute subsystem which works when the nominal loop fails to 
work properly. It is clear that the smaller the least stable dwell time, the better abil- 
ity of fault tolerance. Theoretically, the least stable dwell time captures the subtle 



3.4 Dwell-Time Switching 113 

property of marginal transition among subsystems, which is a unique and important 
phenomenon for switched systems. 

On the other hand, when the subsystems are unstable, the switched system can 
still be stabilizable by means of proper switching among the subsystems. A well- 
known condition for stabilizability is the existence of a stable convex combination 
of the subdynamics, for which high-frequency switching can stabilize the switched 
system. However, high-frequency switching is usually harmful and undesirable in 
most applications. This arises the problem of finding stabilizing switching with the 
largest possible dwell time, which we refer to the slow switching (design) problem. 

In this section, we investigate the above problems in a heuristic manner. As the 
problems are very difficult, we mainly focus on two-form switched linear systems. 



3.4.1 Preliminaries 

For a time-driven switching signal a with the switching sequence 

(to, h), (ti,h), ..., (tu i{), I < +oo, 
its dwell time is the least duration of switching, that is, 

I 

d a = mf{tk-tk-i}. 
k=\ 

It is clear that the dwell time is nonnegative, and positive dwell time implies well- 
definedness, but the converse is not true. For a nonnegative real number r , let S T be 
the set of switching signals with dwell time greater than or equal to r, that is, 

S T — {a eS : d a > x}. 

As an extension, we define the average dwell time of switching signal a as 

,a ■ c , . h — to 

a" — inf hm . 

k-rl k 

For a nonnegative real number r, the set of switching signals with average dwell 
time greater than or equal to x is denoted by S" . It is clear that the average dwell 
time is larger than or equal to the dwell time for any switching signal, and S T is a 
subset of S" for any x. 

For the switched linear system 

x(t) = A a(t) x(t), (3.53) 

let S* be the set of switching signals that make the switched system asymptoti- 
cally stable. A nonnegative real number x is said to be a stable dwell time if each 
switching signal in S T makes the switched system asymptotically stable, and the 
least stable dwell time is defined to be 

r* = inf{r : S T c S*}, 
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which is the infimum over the stable dwell times. The least stable average dwell 
time can be defined in the same manner. 

It can be seen that, when all the subsystems are exponentially stable, the least 
stable (average) dwell time is always finite. Indeed, there exist positive real number 
pairs (oij, fij), j = 1, 2, . . . , m, such that 

\\e Ai '\\<Pje~ a j' Vte%. (3.54) 

Suppose that the switching signal a is with switching sequence 

{tQ,io),{h,h), . . . ,{ti,ii). 

Then the state transition matrix is 

<P(f, to, a) = e A 'k ('-'*> A-i &-*-i> ■ ■ ■ e A %d-'o) Vr e (ftj ft+l]i 

Define 

ln/Ji In 0„ 



x\ — max 



a\ 



It can be seen that any switching signal with dwell time x\ makes the state transition 
matrix norm contractive. As a result, x\ is an upper bound of the least stable dwell 
time. Note that such an upper bound is norm-dependent. 

Another approach for approximating the least stable dwell time is the Lyapunov 
approach. Suppose that Pi , . . . , P m is a sequence of symmetric and positive definite 
matrices. Let r be a positive real number satisfying 

AfPi- PjAj <0 VieM 

and 

e A ? r Pje A < r < Pi Vi, j e M, i^ j. 
Then, by taking the piecewise quadratic Lyapunov function 

V(x,t) = x T P a (t)X, 

it can be seen that, for any switching signal with dwell time t, the Lyapunov func- 
tion is strictly decreasing along switching instants. Hence, the switched system is 
asymptotically stable. As a result, r is an upper bound of the least stable dwell 
time. 

The above idea of using piecewise quadratic functions can be further extended to 
piecewise norm functions. Indeed, the following result has been established. 

Lemma 3.48 (See [261]) x is a stable dwell time for the switched linear system iff 
there exist norms t>,-, i — 1, . . . , m, such that 

v t (e A, 'x) - vi(x) < Vx ^ 0, t > 0, 
Vj (e AiT x) - v t (x) < Vx ^ 0, i, j € M, i ^ j. (3.55) 
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To find a lower bound of the least stable dwell time, we examine the sampled-data 

system 

Xk+\ = D T a x k 

with sampling period r, and D x — e A J T , j = 1, .. . , m. It can be seen that a neces- 
sary condition for r to be a stable dwell time is the guaranteed asymptotic stability 
of the sampled switched system, which can be verified by calculating the spectral 
radius of the sampled system. When the generalized spectral radius is larger than or 
equal to one, then r is a lower bound of the least stable dwell time. Suppose that we 
have found an upper bound r\ for r* . Here we provide a random search procedure 
for computing such a lower bound. 

Step 1. Fix an integer K and set To :— and k :— 0. 

Step 2. Randomly choose a sampling period r from the interval (to, ri). Sample 

the switched system with the period. 
Step 3. Calculate the generalized spectral radius X of the sampled system. If X > 1 , 

then set To := r. Set k :— k + 1. 
Step 4. If k < K, then go back to Step 2. Otherwise, return to as the lower bound 

estimate of the least stable dwell time. 



Example 3.49 For the planar two-form switched linear system with 

A 2 



0.0957 1.4148 
-0.9812 -0.3837 



0.0517 -0.5547 
0.7801 -0.4392 



by solving the Lyapunov equations 

AjPt + PiAi^-h, » = 1,2, 
we obtain (cf. (3.54)) 



1 



2A max (P,) 



A= AnaxWAmin^i). ' = 1,2, 



which further gives x\ — 3.4630. On the other hand, applying the above search 
procedure (with K — 1000) gives to = 1.2425. Thus the least stable dwell time 
r*e (1.2425, 3.4630). 

Next, we turn to the problem of slow switching, where the largest possible sta- 
bilizing dwell time is to be sought. To be more precise, a nonnegative real number 
r is a stabilizing dwell time if there exists a switching signal in S T that steers the 
switched system asymptotically stable, and the largest stabilizing dwell time is de- 
fined to be 

r* = sup{T:S T nSV0}, 

which is the supremum over the stabilizing dwell times. The largest stabilizing av- 
erage dwell-time can be defined in the same manner. 
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For a two-form switched linear system with at least one unstable subsystem, we 
define the set 

A = {(ti, r 2 ) : ti > 0, r 2 > 0,e A,Ti e A2T2 is Schur}. 

It can be seen that, when (ti, r 2 ) e A, the switched system is asymptotically stable 
if we take the periodic switching signal 



*(0 = 



1 if mod (f, ti + x%) < ti, 

2 otherwise. 



(3.56) 



As a result, minfti, r 2 } is a lower bound of the largest stabilizing dwell time, and 
(Ti + r 2 )/2 is a lower bound of the largest stabilizing average dwell time. To obtain 
a tighter estimate, we use the quantities 



sup min{Ti,T 2 } and 

(ti,r 2 )eA 



sup (Ti + T 2 )/2 
(ri,T 2 )e4 



(3.57) 



to serve as lower bounds for the largest stabilizing dwell time and the largest stabi- 
lizing average dwell time, respectively. 

It is interesting to examine the open set A. It is clear that, when A\ and A 2 admit 
a stable convex combination, is an accumulating point of the set, and vice versa. 
Even in this case, the set is not necessarily convex. In fact, the set may contain dis- 
connected subsets, and each connected subset is possibly nonconvex. For example, 
for the two-form switched system with 



-2.1 


1.4 


5.9 


-8.0 


-5.7 


-0.2 


0.6 


5.8 


1.6 



A 2 : 



1.0 

4.8 
-1.0 



-0.5 
-5.0 
-6.6 



-2.8 

1.1 

-2.1 



(3.58) 



it can be verified that wA\ + (1 — w) A 2 is Hurwitz for 0.33 < w < 0.75. Therefore, 
for any w e (0.33, 0.75), there exists a positive real number r such that the segment 
from (0, 0) to {vox, (1 — w)x) belongs to the set A. Figure 3.10 depicts the set that 
contains several isolated subregions. It is clear that the largest subregions are not 
convex. The nonconvexity nature makes the effective computation of the set very 
difficult. 

Another observation is that a periodic switching signal with the largest dwell 
time as defined in (3.57) steers the switched system marginally stable with possible 
very long transient process and very large overshoot. In fact, even for a dwell time 
near the boundary of the set A, the corresponding transient process may be quite 
long. For system (3.58), if we take the periodic switching signal with 

ri= 2.1009, x 2 = 2.1132, 

then it can be verified that the matrix e AlTl e Al - n admits spectra 

{0.6384,-0.7891,-0.0000}, 
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0.5 

Fig. 3.10 The set A 



which means that the transition matrix is Schur stable. This implies that (ti , T2) € A. 
Figure 3.11 shows the state trajectory of the switched system under the periodic 
switching with initial state jto = [1, — 1, 0] T . It is clear that the transient process is 
quite long and the overshoot is very large. 

To improve the system performance, we introduce the notion of e -robust stabi- 
lizing dwell time pair. Precisely, given e > 0, a pair of positive real numbers (ti , T2) 
is said to be an e -robust stabilizing dwell time pair if 

B e (Ti,T 2 )eZ\. 

That is, the ball centered at {x\ , %•£) with radius € is inside the stabilizing dwell time 
set A. The set of such pairs, denoted A € , is a strict subset of the set A. Instead of 
computing the largest dwell time as in (3.57), we are to find the largest e-robust 
stabilizing dwell time defined by 



sup min{Ti,t2}. 

(T!,T 2 )ez\ 6 

The next random searching procedure aims at computing the dwell time. 
Initial Setting 

Set Ti :— and r 2 :— 0. Set two searching steps, k\ and &2. Set e. 



(3.59) 
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-500 
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-1500 



-2000 



-2500 




Fig. 3.11 State trajectory under periodic switching 



Finding Dwell Times 

(1) Set k\ :— k\ — 1 and input two random positive real numbers a and b. 

(2) If k\ <— 0, go to Step 4. Otherwise, check the Schur stability of the matrix 
e A 1 (t 1 +a) e A 2 (T 2 +6)_ If not gQ tQ Step L 

Checking e -robustness 

(3.1) Set/:=* 2 . 

(3.2) If j <— 0, go to Step 3.4. Otherwise, input two random numbers c and d 
between — e and e. 

(3.3) Check the Schur stability of the matrix e M(.ri+a+c) e A 2 (v2+b+d) _ If not> men g0 
to Step 1. Otherwise, set j := j — 1 and go to Step 3.2. 

(3.4) Set Ti :— t\ + a and %2 '■— ti + b. Go to Step 1. 

Conclusion 

(4) Set r := min(ri , Tz), which is an estimate of the largest e-robust dwell time. 

Finally, let us examine the behavior of system (3.58) under various e's. As 
we mentioned before, the transient performance is very poor when e = (cf. 
Fig. 3.11). When e — 0.01, the computed largest e-robust dwell time is 0.8503 with 
Tl = 0.8503 and t2 = 0.8524. Figure 3.12 shows the state trajectory under the peri- 
odic switching, which admits much better transient process than that of e — 0. When 
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Time(Sec) 
Fig. 3.12 State trajectory of under periodic switching with e = 0.01 



€ — 0.1, the computed largest e-robust dwell time is 0.3350 with T\ — 0.3350 and 
r 2 — 0.3634. The corresponding state trajectory, shown in Fig. 3.13, has smaller set- 
tling time and overshoot than those with smaller e's. Notice the interesting trade-off 
between the switching period and the system state performance, which is in fact the 
trade-off between the discrete state quality and continuous state quality. 



3.4.2 Homogeneous Polynomial Lyapunov Approach 



As stated in Lemma 3.48, x is a stable dwell time if inequality (3.55) holds from 
some norms i>,- , i = 1 , . . . , m. This indicates a way of approximating the least dwell 
time. In this subsection, we present a computational approach that searches for a 
least possible stable dwell time when the norms are adopted from homogeneous 
polynomial functions. 

Fix a natural number d. For a positive definite homogeneous polynomial with 
degree 2d given by 



P(x) 



i[,....i„>0 
iiH — \-i„=2d 



>il,... ,!«■*! 
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3 4 

Time(Sec) 

Fig. 3.13 State trajectory of under periodic switching with e = 0. 1 



a norm on R" is induced as v(x) = p^ (x). It is clear that, if there exist a sequence 
of positive definite homogeneous polynomials pi, ..., p m such that 



pi (e Ait x) - pi (jc) < Vx ^ 0, t > 0, 
Pj (e AiT x) - pi (x) < Vx ^ 0, i, j eM, i^ j, 



(3.60) 



for some r, then the induced norms i>,-, i — 1, . . . , m satisfy (3.55), which means that 
r is a stable dwell time for the switched linear system. Note that when d = 1, the 
set of Lyapunov functions degenerate into the set of piecewise quadratic Lyapunov 
functions, and the computation of the quantity can be conducted by means of linear 
matrix inequalities. 

As discussed in Sect. 2.4.1, we take the set of positive definite homogeneous 
polynomials that admit a sum-of-squares expression as 



p(x) = (x [d] ) T Px 



Id] 



where P is a positive definite matrix, and x^ is the of-lift of state x. Denote by A\ 
the induced matrix such that (Ajx)^ — A^x^ and 



dx [d] (t) 
dt 



A%/ d \t). 
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Let N d — ( n+d l ). It can be seen that x [rf] is JV ; f -dimensional and that the matrix 
A [d] hofN d x N*. 

Lemma 3.50 r is a stable dwell time of the switched system if there exists a se- 
quence of positive definite matrices Qj G R " x " , i — 1, . . . , m, such that 

(Af) T Qi + QiAf<0 VieM, 

exp((A ; M ) r r)G i exp(A, M r) < Q t Vi, j eM,i^ j. (3.61) 

Proof It is clear that exp(A ; - r) = (e A ' T )^. The conclusion follows from (3.60) 
with pi(x) = (x [d YQiX [d] . O 

Note that, when r satisfies the second inequality of (3.61), any real number g > r 
also satisfies the inequality with r replaced by g. Indeed, it follows from the first 
inequality of (3.61) that 

e (Aff^-r) Q . e Af\,-r)^ Qu ieM 

[d] t 

Pre- and post-multiplying the second inequality of (3.61) by e^ A < * fc _T ) and 



AY\-r) 



respectively, we obtain 



AdKT, 



exp((A^V s )Qj exp(A| rf] ? ) < e^' ^ Qi e 



Af\ s -t) 



<Qi 



This means that, if we take r as a variable, then inequality (3.61) admits a set of 
solutions with a unique infimum, which is an upper bound of the least stable dwell 
time. 

The above discussion enable us to formulate the optimization problem 

infr 
3gi>0 s.t. (3.61) holds. 

The problem can be solved by means of semi-definite programming technique. The 
resultant solution, denoted r d , is the smallest upper bound of t* when the Lyapunov 
function is in the set of homogeneous sum-of-squares with degree 2d. 

Example 3.51 Consider the planar two-form switched system with 



Ai = 





-2 



1 



A 7 = 







1 



Taking d — 1, 2, 3, 4, we obtain the upper bounds r d presented in the table below. 



0.6222 



0.6079 



0.6073 



0.6073 
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It is clear that 0.6073 is an upper bound of the least stable dwell time. On the 
other hand, we can prove that 0.6073 is also a lower bound of t*. Indeed, let h\ — 
0.8800 and hi — 0.6073. It is straightforward to verify that the state transition matrix 
e Mhi e A 2 h2 ac j m its the spectra { — 1.0000, —0.2260}, which shows the existence of a 
periodic switching that steers the switched system marginally stable. 

To conclude, we have r* = 0.6073, and the homogeneous polynomial Lyapunov 
function approach provides a nonconservative estimate of the least stable dwell time 
for this example. 



3.4.3 Combined Switching 

Based on the largest e -robust stabilizing dwell time, we can further enlarge the dwell 
time by introducing a combined switching mechanism, that is, the state-feedback 
switching with fixed dwell time. 

Next, suppose that ri and r 2 are fixed and that the matrix e A,Tl e A2T2 is Schur 
stable. Clearly, there exist a positive definite matrix P and a real number 8 e (0, 1) 
such that 

(e A2T2 e AlTl ) T Pe A2T2 e A < T < < (1 - S)P. (3.62) 

Assume without loss of generality that ti < r 2 - 

Fix a real number rj e (0, j4j). Let Q t = Af P + PA t , i = 1, 2. Define 



v = 1nfl + 2i?||Ai|| WP) )/(2\\A 



where X m [ n (P) and A max (<2i) are the smallest and the largest eigenvalues of P and 
<2i, respectively. 

Suppose that x is initialized at x(t(f) — xo. Define the switching sequence 

^-j 1 ifx QiX0<XqQ2XQ, 
1 2 otherwise, 

\mf{t>t k + v: x(t) T Qix(t)>0} + n ifa(t k ) = l, „ ,„ 
h+i — { T (3.63) 

\mf{t>t k + r 2 : x(t) T Q 2 x(t)>0} if<r(ft)=2, 

(2 ifo-(ft) = l, 
a{tk+\) — \ k = 0, 1, — 

[l ifo-(ft) = 2, 

According to this strategy, when the first subsystem is activated, it is first kept 
active for time v, and then it must be kept active for the additional dwell time x\ 
after the state-feedback switching time is due. On the other hand, if the second 
subsystem is activated, it must be kept active for the dwell time T2, and then the 
state-feedback switching law decides the next switching time. In this way, the dwell 
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time of the combined switching is greater than or equal to min(ri + v, x 2 ), which is 
larger than the original dwell time x\ . 

The following result states the main property of the proposed switching strategy. 

Theorem 3.52 The switched system is exponentially stable under switching 
law (3.63). 

Proof Let V(x) — x T Px be the Lyapunov candidate. Fix an initial state and sup- 
pose that the switching time sequence is to, t\, Taking any switching instant t k 

with a (tk ) = 1 , we examine the monotonicity of the Lyapunov candidate along with 
the time interval [tk, ffc+2)- According to the switching law, the time-driven period 

is 

[tk, tk + v) U [t k+l - ti,t k+ i + x 2 ), 
while the state-driven period is 

[tk + v, tk+i - Ti) U [t k+i + x 2 , t k+2 ). 

Note that the Lyapunov candidate function is decreasing during the state-driven pe- 
riod. During the time-driven period [t k +\ — X\, f£+i + X2), it follows from (3.62) 
that 

V(x(t k+[ + r 2 )) < (1 - S)V(t k+[ - n). 

For the time-driven period [tk, t k + v), we have 

"t k +v 



ftk+v 

/ x T (t)Q l x(t)dt<r ] V(x(t k )), 

Jt t 



"a 
which further implies that 

V(x{t k + v))<^— & V{x(t k )). 

Combining the above facts together yields 

V(x(t k+2 )) < V(x tk ). 

As the time-driven period is with fixed length t\ + r 2 + v for each switching cy- 
cle, the Lyapunov candidate converges exponentially, and the switched system is 
exponentially stable. 

To illustrate the effectiveness of the proposed switching law, we reexamine the 
example as in (3.58). We take x\ — 0.3350 and x 2 — 0.3634 that correspond to the 
largest e-robust stabilizing dwell time with e = 0.1, Furthermore, take 



P = 



1.1125 0.0681 0.0878 
0.0681 2.1136 1.6565 
0.0878 1.6565 3.4735 



^ = 8 = 0.2180. 
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Fig. 3.14 Sample state trajectory (upper) and switching signal (lower) 



As a result, we have v — 0.0249. It follows that switching law (3.63) admits the 
dwell time of 0.3599, which is larger than 0.3350 for the periodic switching law 
(3.56). Moreover, due to the introduction of the state-driven mechanism, the av- 
erage dwell time can be further enlarged. Figure 3.14 depicts the state trajectory 
and switching signal of the switched system under switching law (3.63) with ini- 
tial state xq — [0.8040, —1.7240, 0.1741] r . For this piece of sample switching path, 
the average dwell time is 0.4672 sec, which is one third larger than that of periodic 
switching (3.56), 0.3492 sec. □ 



3.5 Notes and References 



Stability of stochastic systems is not a new topic, and the history can be traced back 
to the 1950s. Systematic investigations were made by quite a few scholars such as 
Bharucha [27], Kozin [133], Kushner [136], and Khasminskii [131]. In particular, 
Kozin [133] established that exponential mean square stability implies almost sure 
stability, as stated in Theorem 3.1 1. In the survey paper [134], Kozin clarified some 
confusing concepts and explained the relationships among the stability concepts. 



3.5 Notes and References 125 

Much progress has been made in understanding various stabilities since the 1990s. 
The reader is referred to [43, 59, 74, 79, 140, 167] and the references therein. 

The equivalence among the mean square stabilities, as stated in Items (l)-(3) of 
Theorem 3.3, was obtained by Feng et al. [79], which was extended to the 5-moment 
stabilities by Fang [70]. The stability criteria, Items (4) and (5) of Theorem 3.3, were 
presented in [79] and [160], respectively. The proof of Theorem 3.3 was combined 
from [70, 79, 160]. Lemma 3.4 was adapted from [160]. For almost sure stability, 
while many sufficient conditions and necessary conditions were presented in the 
literature (see, e.g., [70, 71, 144, 166]), it was well recognized that, as the Lya- 
punov component is notoriously difficult to calculate [10, 251], almost sure stability 
is much harder to tackle than moment stabilities [61]. It was established, however, 
that as <5 — ► 0, the stability region (w.r.t. subsystem matrices) of <5-moment stability 
shrinks exactly to the stability region of almost sure stability [70, 73]. While this 
reveals the insightful connection between almost sure stability and moment stabil- 
ity, it provides little help in practical verification of almost sure stability, due to the 
lack of verifiable moment stability criteria. The necessary and sufficient condition 
for almost sure stability, Theorem 3.16, was adapted from [42]. Though the criterion 
is of limited practical value, it does provide a counterpart of the transition contrac- 
tion criterion for deterministic switched systems, as presented in [216, Prop. 3]. 
Lemma 3.14 was adapted from [70]. 

It should be noted that the material here is limited to continuous-time homoge- 
neous jump linear systems. For the discrete-time counterpart and/or jump diffusion 
counterpart, the reader is referred to [59, 70, 72, 144, 160] and the references therein. 

Piecewise linear systems are switched linear systems with state-space-partition- 
based switching. Theoretically, piecewise linear systems are powerful in approxi- 
mating highly nonlinear dynamic systems [210], in representing interconnections 
of linear systems and finite automata [212], and in characterizing control systems 
with fuzzy logics [76]. From the model point of view, piecewise linear systems 
provide an equivalent framework to the well-known linear complementary systems 
[101, 102, 143] and mixed logical dynamical systems [23, 174]. Primary topics in 
the literature include well-posedness [116, 265], controllability, reachability, and 
observability [11, 49, 202], stability and stabilization [93, 94, 119, 125, 126], and 
computational complexity [40], among others. While the study on stability of piece- 
wise linear systems has been attracting increasing attention, the stability problem 
is found to be notoriously challenging [29, 230]. One reason for this is the fact 
that switching is autonomous based on cell partitions which usually induce highly 
nonlinear transition maps that are very difficult to characterize. Nevertheless, re- 
markable progress has been made during the last decades, with much attention be- 
ing paid to the development of computational approaches. The piecewise quadratic 
Lyapunov approach, proposed initially by Johansson and Rantzer in [125, 126], pro- 
vides a rigorous method for analyzing the stability of general piecewise linear sys- 
tems. To find qualified piecewise quadratic Lyapunov functions, we usually need 
to further partition the cells, which makes the computation inefficient for higher- 
dimensional systems. This motivates the development of a natural-partition-based 
mechanism to reduce the computational burden. The surface Lyapunov function ap- 
proach, proposed by Goncalves et al. in [92, 93], is exactly such an approach. It 
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focuses on the contractility of the impact maps defined over the switching surfaces 
instead of the total state space, which captures and utilizes the subtle properties 
of the impact maps that are generally nonlinear and multivalued. The approach is 
powerful in coping with piecewise linear systems whose impact maps could be pa- 
rameterized. Particular but important examples include a linear plant with a non- 
linear relay/on-off/saturated feedback. It is clear that the approach only applies to 
continuous-time systems. An extended scheme is to analyze the transition relation- 
ships among different cells, which could possibly be represented by a digraph. By 
applying the graph theory, it is possible to reduce global graph analysis to that of 
subgraphs which are invariant and attractive. While simple, the approach applies to 
both continuous time and discrete time. 

The main results in Sect. 3.3.2 were adapted from [126], and the contents 
in Sect. 3.3.3 were mainly taken from [93]. The transition analysis presented in 
Sect. 3.3.4 was proposed in [226], where the concept of (weak) transitivity was bor- 
rowed from [119]. As a specific class of piecewise linear systems, conewise linear 
systems admit simpler behavior; for example, a continuous conewise linear system 
is always well defined as no Zeno phenomenon occurs [50]. Proposition 3.42 reveals 
another nice property for the system, which naturally follows from the homogeneity 
of the switched system [8]. The other part of Sect. 3.3.5 was taken from [229]. 

Switching with positive dwell time or average dwell time was proposed to ad- 
dress the stability problem by Morse and Hespanha in [110, 178], and numerous 
works could be found along this line in the literature, see, e.g., [56, 90, 99, 197, 278] 
and the references therein. While simple in idea and popular in literature, finding the 
least stable dwell time for stability of switched stable linear systems is very diffi- 
cult due to the fact that the concatenation of two feasible switching signals is not 
necessarily feasible, which destroys the semigroup nature of the transition matrices 
[261]. A closely related problem is to find the largest dwell time for stabilizability 
of switched unstable linear systems, which is also an open problem. The reader is 
referred to [234, Problem 7.6] for more discussion on the problems. 

The homogeneous polynomial Lyapunov function approach presented in 
Sect. 3.4.2 was mainly adopted from [56], and the reader is referred to [57] for 
more detailed background about the approach. The other material of Sect. 3.4 was 
mostly taken from [227]. 



Chapter 4 
Designed Switching 



4.1 Preliminaries 

To effectively control complex dynamics with either high nonlinearity or large-scale 
unknown/uncertain parameters, it is a common practice to use the "divide and con- 
quer" strategy. One approach in light of this strategy is the hybrid control scheme, 
which amounts to designing a set of candidate controllers, each working around a 
local support, and a switching mechanism coordinating the switching among the 
candidate controllers. Indeed, this hybrid control scheme integrates the ideas from 
several well-known conventional control schemes such as gain scheduling, intel- 
ligent control, and adaptive control [78, 107, 183]. One good example is hybrid 
control of nonholonomic systems which are not stabilizable by means of any indi- 
vidual continuous state feedback controller [106, 132]. Even for simple linear time- 
invariant (LTI) systems, the performance (e.g., transient response) can be improved 
through controllers/compensators switching [81, 118, 169]. 

For a hybrid control system, when the candidate controllers are known or de- 
signed, the overall system is the switched dynamical system described by 

* + (0 = /a<0(*(0). (4-1) 

def 

where x(t) e R" is the continuous state, a(t) e M — {1, . . . , m\ is the discrete 
state or switching signal, /; : R" \-> R" is a Lipschitz continuous vector field with 
/; (0) = for any i e M, and x + denotes the derivative operator in continuous time 
and the shift forward operator in discrete time. 

The issue of this chapter is the stabilizing switching design of switched dynam- 
ical system (4.1). For this, we assume that the switching signal is observable and 
controllable and that we can freely select the switching mechanism. 

For clarity, we denote by <j)(t; to, xq, a) the continuous state of system (4.1) at 
time t with initial condition x(to) = xq and switching path/signal/law a . Denote 
•^p-norm by | • \ p for p e[l, +oo]. For any positive real number r, let 

B r = )i-eR": \x\<r}, H r = {*eR": \x\=r}. 
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Finally, recall that, for a time interval z& , S m is the set of well-defined switching 
paths defined over the interval, and S is the set of well-defined switching signals. 

Definition 4.1 Switched system (4.1) is said to be 

(1) {uniformly) stabilizable if for any e > 0, there exist 8 > and a switching law 
{p x : x eBg} such that 

\(/>(t;Q,x,p x )\ <s WxeB s ,te% (4.2) 

(2) (globally uniformly) switched attractive if for any € > and y > 0, there exist 
a switching law [p x : x e B y } and a time T > such that 

\<p(f,0,x,p x )\ <e VxeB y , reTj (4.3) 

(3) (globally uniformly) asymptotically stabilizable if for any e > 0, € > 0, and 
y > 0, there exist S > 0, 7" > 0, and a switching law {p x : x e R"} such that 
relationships (4.2) and (4.3) hold simultaneously, and 

(4) (globally uniformly) exponentially stabilizable if there are positive real numbers 
a and ft and a switching law {p x : x e R"} such that 

\tf>(f,0,x,p*)\ </3e-°"\x\ VxeR", t eT 

The switching law {p x } in the definition is said to be an (asymptotically/expo- 
nentially) stabilizing/ switched-attractive switching law, respectively. 

Note that the uniformity is referred to the switching law rather than the initial 
time as in the conventional stability notions, and asymptotic stabilizability means 
stabilizability and switched attractivity w.r.t. a (common) switching law. In partic- 
ular, even when a switched system is both switched attractive and stabilizable, it is 
not necessarily asymptotically stabilizable. Indeed, if we take the first subsystem 
with an attractive but unstable origin equilibrium and the second subsystem with an 
identity motion (that is, each state is an invariant equilibrium), then, it is clear that 
the switched system is both switched attractive (by assigning a — 1) and stabilizable 
(by assigning a — 2), but the switched system is not asymptotically stabilizable. 

In this chapter, we address the problem of stabilization by designing various 
switching mechanisms including time-driven switching, state-feedback switching, 
and mixed-driven switching. The aim is to reveal the capability and limitation of 
each switching mechanism, to provide a comprehensive understanding of the stabi- 
lization problem and to present computation design procedures. 



4.2 Stabilization via Time-Driven Switching 

In this section, we examine the possibility of achieving stabilizability by means of 
time-driven switching. For this, we introduce the notion of consistent stabilizability. 
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Definition 4.2 Switched system (4.1) is said to be consistently (asymptotically, ex- 
ponentially) stabilizable if there is a consistent switching signal a such that the 
system is well defined and uniformly (asymptotically, exponentially) stable. 

It is clear that a consistent stabilizable system is also stabilizable in the sense of 
Definition 4. 1 . We are interested in whether the converse is still true or not. Indeed, 
if any stabilizable system is also consistently stabilizable, then the stabilized system 
is in fact a linear time-varying system with a piecewise constant system matrix, and 
the problem of stabilization can be seen as a special case of stability problem for 
linear time-varying systems. This, however, is not generally true, as shown in the 
sequel. 

Consider the switched linear system given by 



x + (t) ■■ 



A a(f )x(t), 



(4.4) 



where A, , i e M, are real constant matrices. 

Lemma 4.3 Suppose that the switched linear system is consistently stabilizable. 
Then, there is k e M such that 



£*j(A*)<0 



i = i 



in continuous time and 



\~[^(A k ) 



i=l 



< 1 



(4.5) 



(4.6) 



in discrete time, where A.; (A), 1 < i < n, are the eigenvalues of the matrix A. 

Proof We proceed with the continuous-time case, and the discrete-time case could 
be proven in a similar way. Let a be a consistent switching signal that stabilizes the 
switched system. Suppose that the switching duration sequence of a is 



DS„ 



[(io,Ao)>(»i,Ai)> 



If the sequence is finite, i.e., there involve only finite switches in a , then, it can be 
seen that the last active subsystem must be stable, and the theorem follows immedi- 
ately. If the sequence is infinite, it follows from the well-definedness of a that there 
involve only finite switches in any finite time. As a consequence, ^_j hi — > oo as 
/ -¥ oo. According to Definition 4.2, by setting e = 1, there exists S > such that 



ll*o II <& 



U(r; 0, x ,cr) < 1 Vr > t . 



In particular, 



\ e M s h s . . . e A n hl e A lo h Qx U < j VxQ e g^ g = q j 
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As a consequence, all entries of the matrices 

e A / *<> e^'i^e^o* , „ e A i> h > . . . e A h hl e A 'o h ° , ... (4.7) 

must be bounded by 4 . Suppose that 



Then, we have 

dete A *'' =exp(hJ2 k '( A k)) >e eh , keM, h>0. 

As a result, we have 

dete A '^ ■ ■ ■ e A n hl e Ai o h ° > e e ^=° h J -> oo as s -+ oo. 

This contradicts the boundedness of entries of the matrices. This establishes the 
former part of the theorem. The latter part can be proven in a similar manner. □ 

Recall that a switching signal %),cx>) is said to be periodic if there exists a positive 
time T such that 

6(t + T) = e(t) Vf>0. 

Proposition 4.4 If a switched system is consistently asymptotically stabilizable, 
then, there is a periodic switching signal that asymptotically stabilizes the switched 
system. 

Proof If there is a subsystem, say, Aj, that is asymptotically stable, then the constant 
switching signal a =k works. Otherwise, suppose that a switching signal a with 
duration sequence 

DS a - {(io.Ao), (»i,/»i), ■••} 

asymptotically stabilizes the switched system. It is obvious that this switching signal 
must involve infinite switches. From the proof of Lemma 4.3, matrix sequence (4.7) 
converges to the zero matrix. Consequently, there is a finite number JV such that 

\\ e A iN h N... e Ai i hl e Ai o ho \\ < 1. (4.8) 

It can be verified that the periodic and synchronous switching path 8 with duration 
sequence 

DS e = {0'o,s ), ..., Un,sn), (io,s ),...,(i N ,SN), ■••} (4.9) 

asymptotically stabilizes the switched system. □ 
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Estimation (4.8) is very important in analyzing the convergence of the sys- 
tems. It establishes the contractibility uniformly for all initial states. Indeed, let 
<P(T,0,p) be the state transition matrix under switching path p over interval 
[0, T], Inequality (4.8) is equivalent to the contraction of the transition matrix, i.e., 
11^(7,0,^)11 < 1. This motivates us to construct a periodic stabilizing switching 
signal a as a(t) — p(t) for t e [0, T) and o{t + T) = a(t) for all t. Under this 
periodic switching signal, the resultant switched system is in fact a periodic linear 
time-varying system whose lifting system is Schur stable, and its dynamics is well 
understood. Note that the stabilizing switching signal is always well defined as it is 
self-concatenated of the well-defined switching path p. 

Corollary 4.5 For a switched linear system, the following statements are equiva- 
lent: 

(i) the system is consistently asymptotically stabilizable 
(ii) the system is consistently exponentially stabilizable 
(iii) the system is periodically asymptotically stabilizable 

(iv) there exist a natural number I, an index sequence zi , ...,/;, and a positive real 
number sequence h\, ...,hi such that the matrix e '' ' ■ ■ ■ e 'i 'is Schur, and 
(v) for any real number s e (0, 1), there exist a natural number I — l(s), an index 
sequence i\, . . . ,ii, and a positive real number sequence h\, . . . ,h/ such that 

\\e A -i h '--.e A -i h[ \\<s. (4.10) 

Proof From the proof of Proposition 4.4, (i) implies that there is a finite number N 
such that 

\\ e A ' N , "v ... e A -i h <e A 'i h '\\ =y <1 

for some sequences i\, ..., iff and hi, ... ,hff. Let / = kN, where k will be deter- 
mined later. Define 

ij+fiN = ij and h j+/lN =hj, j = 1, ... , N, p,— 1, ..., k- 1. 

It can be seen that 

leV . ..^1*1^1*1 j) = (j e A i N h N . .. e A n h ^ e A -i hl \\f = y k . 

Accordingly, for any s e (0, 1), by letting k > ^, inequality (4.10) holds. This 
means that (i) =>■ (v) . In the same manner, we can prove that (iv) ^=S> (v) . Other 
implications are trivial, and the corollary follows. □ 

Finally, utilizing the Lemma 4.3, we present two examples that are stabilizable 
but not consistently stabilizable. 

Example 4.6 For the planar continuous-time two-form switched system with 



2 
-1 



1 1 
-1 1 
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it can be verified that condition (4.5) does not hold, and thus the system is not 
consistently stabilizable. 

On the other hand, the system can be made asymptotically stable by means of the 
following switching law: activating the second subsystem until the state reaches the 
X2-axis and then turning to the first subsystem forever. 

Example 4. 7 For the planar discrete-time two-form switched system with 



3 

1/2 



A 2 : 



101 

loo 



cos0r/18) sin(jr/18) 
-sin(7r/18) cos(;r/18) 



it can be verified that condition (4.6) does not hold, and hence the system is not 
consistently stabilizable. On the other hand, the system is asymptotically stabilizable 
due to the following facts: 

(1) for any state y in the cone A — {x e R 2 : | arctan(xi/x2)| < ir/36}, |Aiy| < K\y\ 
with k « 0.7596 

(2) for any state y outside the cone, applying A2 by k v times (ky < 17) will steer y 
into the cone, and 

(3) \A y A k ^y\ oc\A^y\<K\\A 2 \\ k y\y\<ic\\A 2 \\ ll \y\ < fi\y\ with \i « 0.8996 




Fig. 4.1 Sample phase portrait 
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Therefore, a stabilizing switching law is to activate the first subsystem when the 
state is in cone A and to activate the second subsystem when the state is outside the 
cone. Figure 4. 1 shows a sample phase portrait of the switched system. 

The above examples exhibit that not all stabilizable systems can be made stable 
by means of time-driven switching laws. That is, time-driven switching laws are not 
universal for stabilizing switched systems. 



4.3 Stabilization via State-Feedback Switching: The Lyapunov 
Approach 

In this section, we investigate the possibility of using the Lyapunov approach for 
addressing stabilizability issues. For this, we need to define a proper set of Lyapunov 
function candidates. 

Definition 4.8 Function V : R" i-> R + is said to be a switched Lyapunov function 
for switched system (4.1) if 

(1) it is locally Lipschitz continuous 

(2) it admits class K-oo bounds, that is, there are class /Coo functions r)\ and r]2 such 
that 

m(M)<V(x)<r, 2 (\x\) VxeR" 

and 

(3) the least upper Dini derivative of V along vectors /,(x), i e M, is negative 
definite. That is, there is a positive definite continuous function w : R" i->- R + 
such that 

mm V T V(x)\f. — minimum < — w(x) 

ieM J ' ieM r^0+ T 

in continuous time and 

min£> + V(x)| f; = f minV (fi(x)) - V (x) < -w(x) 
ieM J ieM v ; 

in discrete time 

Remark 4.9 The local Lipschitz continuity of the Lyapunov function implies that 

,. . V(x + rfi(x))-V(x) V(Hr;0,x,i))-V(x) 
lim inf = hm int 

in continuous time, where i stands for the constant switching signal a(t) — i V?. 
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Suppose that switched system (4.1) admits a switched Lyapunov function V. 
Then, the switching law 

a(f+) = argmin{D + V(x(0)L} (4.11) 

ieM 1 v "■>•' 

steers the switched system asymptotically stable, provided that the switching law is 
well defined. Note that chattering might occur when the switching surface 

{x e R" : 3i, j s.t. V+V(x)\ fl = V+V(x)\ fj } 

is a sliding mode. To avoid such ill-defmedness, we can use the hysteresis switching 
law as follows. Define the regions 



xeR": V+V(x)\ f . < -minV + V(x)\ f . , ieM. (4.12) 

J ' ~ 2jeM Jj ] 



Qi = 



Starting from any given initial state x(0) = xq, select the index of the active subsys- 
tem at ?o = as 

a xo (t ) = argmm{V + V(xo)\ fi }. 
ieM 

If there are two or more such indices, we simply choose the minimum one. The 
consecutive switching times/indices can be recursively selected as 

t k = M{t>t k -i: V + V(x(t))\ Ui ) ^flo-te.i)}, 

"'^ (4.13) 

a x o(t k ) = argrmn{V + V(x(t k ))\ f .}, k=l,2,.... 

ieM 

It can be proven that this hysteresis switching law is well defined and that it steers 
the switched system asymptotically stable. 



4.3.1 Converse Lyapunov Theorems 

Suppose that the switched system is asymptotically stabilizable. We are to prove 
the existence of a switched Lyapunov function as in Definition 4.8. To this end, we 
need some technical preliminaries adapted from the proofs for converse Lyapunov 
theorems of (nonswitched) nonlinear systems (cf. [130, 152]). 

Firstly, it follows from the asymptotic stabilizability that there exist a class ICoo 
function a and a class ICC function f> such that for any initial state x, we have a 
switching signal Q x e S satisfying 

\<p(t\0,x,6 x )\ <a(\x\) VreT (4.14) 

and 

\<p(t,0,x,e x )\<p(\x\,t) We T . 
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The latter can be equivalently represented by 

a(\<p(t;0,x,e x )\)<p(\x\,t) VxeR", te%, (4.15) 

with p — a o p. It is clear that /3 is a class ICC function. 
Secondly, define the function g : R" i-> R + as 

g(x)=sup inf \<f)(f; 0,x, a) . 

teT Q aeS [Oj] 

It is clear that the function is well defined and 

\x\<g(x)<a(\x\) VxeR". (4.16) 

It can be seen that 

g(x)> inf g(4>(t;0,x,cx)), WeT ,xeR". (4.17) 

aeS[o.i] 

Thirdly, we show that the function g is locally Lipschitz continuous at any 
nonorigin state. Given x ^ 0, let positive real numbers y\ and yi be such that 
Y2 < \x\ < yi, and let T be the time constant corresponding to y — y\ and e — y2 
as defined in Definition 4. 1 . It can be seen that 

g(x) = max inf \<t>(t\ 0,x,a) . 

te[0.T]aeS [0 ,,) 

As a result, for any e > 0, there is a switching path 6 e <S[o,:r] such that 
g(x) > max \<p(t; 0, x,6) \— e. 

Let L x = max{L j , . . . , L x m }, where L| is the Lipschitz constant of /, at x for i e M. 
Choose a sufficiently small positive real number r such that 

\x\+r<yi, \x\-r>Yi, 

and 

|/K;yi)-./K:y2)|<£*|yi-;y2l v/eM, yi ,y 2 &B(x,r). 

It can be verified that, for any y e B(x, r), we have 
g(y) < max \<j>(t\ 0, y, 6»)| 

< max (|0(r;O,x,0)|+e LV '|x-y|) 
re[0,T] M ' 7 

< max \(b(t;0,x,6)\ +e L ' XT \x-y\ 
te[0,TY ' 

<g(x) + e L ' V:r |x-y|+e. 
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From the arbitrariness of e and the interchangeability of x and y we have 
|*G0 " S00| < e? T \x -y\ Vy e B(x, r), 

which shows that g is locally Lipschitz continuous at x. Note that while we do not 
prove that g is locally Lipschitz continuous at the origin, g is indeed continuous at 
the origin due to the facts that g{x) < a{\x\) and a is of class K,. 
Fourthly, define the function V : R" i-> R+ by 



V(x) — sup inf 
teT a ^ s 



\ / x 1 + 2t 1 



It follows from relationships (4.16) and (4.17) that 

1*1 < g(x) < V(x) < 2g(x) < 2a(\x\). 



(4.18) 



By the similar argument used with g, we can show that V is locally Lipschitz con- 
tinuous at any nonorigin state. It is clear that V is continuous at the origin. 

Fifthly, fix x ^ and i e M. It follows from inequality (4.15) that there exists 
a function i/r : R + x R + i->- R + such that \jr{u,-) is continuous and decreasing for 
any fixed u, i/r(-, v) is increasing for any fixed v, and 

I6p(u,i{r(u,v)) <a~ l (v) V«,«eR + . 
Denote p = (1 + iA(l x l> a (M))) 2 an d let r > be a time with 

inf inf VU(t;0,x,(x)) > 

te[0.z]aeS m] 

For any h e [0, r], we have 

V(<p(h; 0,x, in = sup inf 

= sup inf 



1*1 

2 



' / - , 1 + 2r 1 

g[<j)(t + h;0,x,a o h 0) : [, 



where a o/, i is the switching path that concatenates i and a at time h, 

(a o h i)(t) ■■ 
It follows that, for any given e e (0, j£J-), there is a time £ e (0, r) such that 



\i, te[0,h), 

\a{t — h), te[h,+oo). 



mm ' 

ieM 



VU(h;0,x,i))< sup inf \g(<t>(t + h;0,x,(x))^—\ +e (4.19) 

rsTo^sSl 1 + r | 



4.3 Stabilization via State-Feedback Switching: The Lyapunov Approach 137 

for any he [0, f ]. Utilizing the fact that 

l + 2t 

inf gU(t + h;0,x,cj)) <2 M a(\(p(t + h;0,x,a)\) 

aeS 1 + 1 aeS 

<20(\x\,t + h), 

we see that for all / + h > ^/(\x\, a(|x|)), 

/ \ 1+ 2f 

inf g((p(t + h\ 0, x, a))- h s 

aeS 1 + 1 

< -|x| < inf -V(<t>(h;0,x,a)) < min- V(</>(/i; 0,x, i)). 
4 <r€<S 2 ieM 2 

This, together with relationship (4.19), implies that the supremum in (4.19) is 
reached at some s with s + h < \jr(\x\, a(|x|)). As a result, we have 

min V (<p(h; 0,x,i)) < inf g(<j>(s + h; 0, x, a)) ^1 +e 

ieM ' aeS[ 1 + s J 

, , 1 + 2s + 2h ( 

g(<Ks + h;0,x,a))-f- — 1 

1 + s + n \ 



< inf 

ereS 



l+2s + 2hf, h\\ \x\ 
2p)\ + Tp 



<V(x)(l- — j V/ie[0,^]. (4.20) 

Finally, we show that the function V is strictly decreasing along at least one 
subsystem. Define the function 

\x\ 1*1 

w(x) — — = 



Ap 4(l + ^(|x|,a(|x|)))^ 

which can be verified to be continuous and positive definite. It follows from (4.20) 
that 

V((p(x;0,x,h)- V(x) 
minliminf < — w(x) (4.21) 

ieM T ^0+ T 

for any x ^ 0. It is clear that the inequality still holds at the origin. By Remark 4.9, 
the local Lipschitz continuity of the Lyapunov function implies that 

V(x + xfi(x))-V(x) 
minliminf v J " — < -w(x) Vx e R". 

ieM r^0+ T 

As a result, the function V is a switched Lyapunov function for the switched system. 
The above discussion leads to the following conclusion. 

Theorem 4.10 A switched nonlinear system is asymptotically stabilizable iff it ad- 
mits a (smooth) switched Lyapunov function. 
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Remark 4.11 The theorem converts the verification of asymptotic stabilizability of a 
switched system into the searching of a switched Lyapunov function for the system. 
The equivalence connection is important as it extends the conventional Lyapunov 
method to the switched Lyapunov approach for the stabilizability of switched sys- 
tems. 

Next, we restrict our attention to the switched linear system (4.4). 
Note that, if the system admits a switched Lyapunov function V which is posi- 
tively homogeneous with degree one, i.e., 

V(Xx) = \X\V(x) Vx e R", AeR, 

then the state-space partitions £2j, i e M, as defined in (4.12), are O-symmetric 
cones, i.e., 

xeQ, «=4> XxeQ; Vjc, i,k^0. 

In this case, the resultant hysteresis switching law (4.13) is radially invariant in the 
sense that a x — a for any ieR" and A. ^ 0. This further implies that the state 
trajectories are radially linear, i.e., 

<p{t;Q,\x,o Xx )=\<p(t;0,x,o x ) VieR", AeR. (4.22) 

The radial linearity property is important due to the fact that, if we make the dynam- 
ical system well behaved locally, then it also well behaves globally. 

Theorem 4.12 Any asymptotically stabilizable switched linear system admits a 
switched Lyapunov function which is globally Lipschitz continuous and positively 
homogeneous with degree one. 

Proof We proceed with the continuous-time case, and the discrete-time case can be 
proven in a similar manner. Suppose that the switched linear system is asymptoti- 
cally stabilizable. Define the function V : R" i-> R + as 



I \<p(f,0,x,a) 

i Jo 



V(x)= inf / \4>(t;0,x,a)\dt, (4.23) 

ae<S[o,r] , 

where T will be determined later. Due to the fact that asymptotic stabilizability 
implies exponential stabilizability [218], the function is well defined, positively ho- 
mogeneous with degree one, and 

/ e~' lt dt\x\<V(x)<-\x\ VieR", (4.24) 

Jo a 

where a and ft are as in Definition 4.1, and n — max{||Ai||, . . . , ||A m ||}. 
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Choose T to satisfy the following property: For any given state x ^ 0, there is a 
positive real number e x such that for any switching path a with 



Jo 



'>(t;0,x,cT)\dt< V(x) + e x , 
Jo 

we have 

Ixl 
\4>(t;0,x,a)\<— VteT T . 
8 

This choice is always possible due to the fact that the finiteness of the integration 
with T — >■ +00 implies the convergence of corresponding state trajectory (cf. [220]). 
For any fixed switching signal a, time t, and states x and y, it is clear that 

/ \<j>(t;0,x + y,a)\dt < \<j>(t; 0,x, a)\ dt + / \<j>(t;0,y,o)\dt 
Jo Jo Jo 

< I \<j)(t;0,x,cr)\dt+ f e' 1 ' dt\y\. 
Jo Jo 

This implies that the function V is globally Lipschitz continuous with Lipschitz 
constant ji — L e vt dt. 

Due to the global Lipschitz continuity, it can be seen that 

, V(x + rAix)-V(x) 
minP^y^)!^.,; = minliminf 

ieM ' ieM t^0+ T 

V(<t>(r;0,x,G))-V(x) 
— mi hm mi . 

<TS<S[o.r] T^0+ T 

Finally, let s be a positive time with 

\x\ 
\<p(f,0,x,a)\ > — Wt <s, a eS[ ,s)- 

For any state x ^ and any positive real number e < e x , there is a switching path 
a x such that 

inf V(4>(t;0,x,a))= inf inf / \(j>(r;0,(t)(f,0,x,a),Q)\dT 

a£S[0 t T] T6<S[0,T] es<S[o,r] Jo 

< / \4>(r;0,x,cr x )\dx- / \(p(T;0,x,a x )\dr 
Jo Jo 

pT+t 

+ / \<j)(r;0,x,a x )\dr 



<V(x) + e-—t Vt<s. 
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By the arbitrariness of e, this yields 

V((t>(r;0,x,G))-V(x) \x\ 
inr hm mi < , 

aeS[ .T\ t^0+ r 4 

which shows that the function V satisfies the last item in Definition 4.8. □ 

Remark 4. 13 Note that in the proof of Theorem 4.12, the switched Lyapunov func- 
tion given in (4.23) may be nonsmooth. While the function can be smoothed by 
the standard technique, the smoothed function is not necessarily homogeneous 
any more. Putting Theorems 4.10 and 4.12 together, an asymptotically stabilizable 
switched linear system admits a switched Lyapunov function that is either smooth 
or positively homogeneous. 



4.3.2 Nonconvexity of Lyapunov Functions 

Recall that for guaranteed stability of switched linear systems, asymptotic stability 
always implies the existence of a convex and homogeneous Lyapunov function. As 
convexity is a crucial requirement from the computational points of view, it is ex- 
pected that stabilizability also implies the existence of a convex switched Lyapunov 
function. This, however, is not true as exhibited by the counterexamples as follows. 
For any subset 1Z of the state space, time T > 0, and switching signal er , define 
the set of attainable states to be 

C T (Tl,a) = {(j)(f, 0,x,cr): teT T , xeU}. 

For a positive definite function V : R" — ► R_|_, define the set of compliant switching 
signals w.r.t. V to be 

S v = {a eS: V((t>(h;0,x,a)) < V(0fe; 0,x,a)) Vfi >t 2 , x^O}. 

As a preliminary preparation, we introduce the following lemma. 

Lemma 4.14 Suppose that RcR" is a compact set and H^ {0} . If switched linear 
system (4.4) admits a convex Lyapunov function V , then, we have 

K£co{C T (K,o-)} Vr>0, aeS v . (4.25) 

Proof Suppose that V is a convex switched Lyapunov function and that a is a 
switching signal compliant with V. Fix T > 0. It is clear that 

sup V[d>(t; 0,x, er)) < max V(x). 
xeTZ,teT T x€TZ 
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It follows from the convexity of V that 



sup V(x) < max V (x), 
xeco{C T (TZ,c)) - ve7 ^ 

which immediately leads to relationship (4.25). 



□ 



Example 4.15 Consider the planar continuous-time switched linear system given by 



x — A a x, a e {1, 2} 

1 
-1 



(4.26) 



y -1 
1 Y 



where y > is a parameter. 

Note that both subsystems are unstable. However, the X2-axis is a stable invariant 
subspace for the first subsystem, and the second subsystem rotates at a constant 
angular speed. Therefore, any initial state away from the X2-axis can be steered to the 
axis in a finite time. This clearly means that the switched system is asymptotically 
stabilizable. However, as proven below, Lemma 4.14 is violated, and the switched 
system does not admit any convex switched Lyapunov function. 

Proposition 4.16 There exist a time T > and a positive real number yo such that 

HiC C o{C T (Hi,o-)} Vy > y , a e S. 

To prove the proposition, we first consider the convex sector 

D= {xeR 2 : x x > \x 2 \}. 

See Fig. 4.2. Let V(x) — jX T x. It is clear that V(x)\aj is nonnegative for any x e D. 
In addition, for the phase at x e D, 6{x) — arctan(— ), and its derivative can be 
computed to be 



6(x)\ 



2xiX2 



e(x)u 2 = h 



1 ~ 2 

As a result, for the lower part of D which is in the fourth quadrant, the rotation is 
always counterclockwise. The above analysis means that, for any initial state x at 
the lower part of D and any switching signal a that steers the system convergent 
from x, the state trajectory must intersect the xi-axis and abandon D by crossing 
the radial b — {x e R 2 : x\ — x 2 , x\ > 0}. 

Then, let us have a closer look at the possible intersectant states. For this, let 

xo = \rQ-, — 2 J 7 "' anc ^ S X ° ^ e me set of switching signals that steer the system 
convergent from xq. Define 



*? = inf{*i : It e%, a eS x ° s.t. [x^O] 7 " =4>{t; 0,x ,a)}, 
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x™ 




Fig. 4.2 Phase portrait, the convex hull, and the unit circle 

which is the state with least norm that is intersectant with xi-axis, and 

x h — 2 ^ x * — infjjc 2: 3t e %, a eS Xc , s.t. [x2,x2] r =(j>(t; 0,x c ,a)}, 

which is the state with least norm that is intersectant with radial b. 

Next, we estimate the locations of x\, and x c . To this end, let g be the radial 
g = {x eR 2 : x\ — — (y + Vr+l) x 2> *i > 0}. Rewrite the state equation as 



dx2 
dx\ 



yx\-X2' 



a =2. 



The curve that generates x c is thus achieved by taking a — 1 as long as the state is 
below radial g and by taking a — 2 when the state is on or above g . Denoting by x g 
the intersectant state with g, routine calculation yields 



+ 7^+1 



def 
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As V (and the norm) is nondecreasing on D, we have 

\Xb\ > \X C \ >K. 

Finally, note that the above argument also holds for — xo with region —D — 
{— x : x e D}. We thus have — x c and — Xb accordingly. It can be seen that the unit 
ball is strictly inside co{x£,x c , —Xb, —x c ) if K > cot j ~ 2.6131, which can be guar- 

def 

anteed when y > 7 = yo- Note that the above estimate is conservative, and extensive 
simulation exhibits that y > 1.2 still works. 

To summarize, Proposition 4.16 holds for Example 4.15. It follows from 
Lemma 4.14 that the switched system does not admit any convex switched Lya- 
punov function. 

Example 4.17 For the planar discrete-time switched linear system 

x{k+l) = A a{k) x(k), ae{l,2}, (4.27) 

A-2 — V 



A X = 



fi 




cos(0) -sin(0) 
sin(0) cos(#) 



we assume that —Itt and that v and /i are sufficiently large positive real numbers. 

It is clear that both subsystems are unstable. Notice that, however, the first sub- 
system steers any state on the X2-axis to the origin in one step and steers any other 
state to the xi-axis in one step. On the other hand, the second subsystem steers any 
state on the xi -axis to X2-axis in four steps. This clearly means that the switched sys- 
tem is asymptotically stabilizable. But it can be proven that Lemma 4. 14 is violated, 
and the switched system does not admit any convex switched Lyapunov function. 

Let TZ — {|>i, 0] r : x\ e [-1, 1]} and x — [1, 0] r . Note that to make a state 
x norm contractive in one step, it is necessary that x e Q — {[x\,X2\ T '■ x\ > 
(fi 2 — l)x 2 }. To steer xo or — xo to region Q, one needs at least four steps along 
the second subsystem, while at each step the state norm strictly increases. Applying 
the first subsystem during the process leads the state back to the xi-axis with larger 
norm. These facts clearly indicate that any convergent trajectory starting from xo 
must admit a convex hull that strictly contains 1Z as an interior. It follows from 
Lemma 4.14 that switched system (4.27) does not admit any convex switched Lya- 
punov function. 

Remark 4.18 From the above two counterexamples, an asymptotically stabilizable 
switched linear system does not necessarily admit a convex switched Lyapunov 
function. As an implication, function sets like piecewise linear and polynomials are 
not universal as switched Lyapunov function candidates. Recall that, for guaranteed 
stability, a convex (and homogeneous) Lyapunov function always exists. The sub- 
tle difference stems from the following facts. On the one hand, guaranteed stability 
means stability under arbitrary switching, and a Lyapunov function takes the largest 
possible energy with respect to all the switching signals; hence the function is con- 
vex if the energy function for each switching path is convex, which is indeed the 
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case due to the linearity of the subsystems. On the other hand, stabilizability only 
implies stability along certain switching signals, and a Lyapunov function takes the 
least possible energy w.r.t. the switching signals; thus the function might not be 
convex even when the level set for each subsystem is convex. 



4.3.3 Min Quadratic Lyapunov Functions: An Optimization 
Approach 

As convex Lyapunov candidates are not universal for solving the problem of sta- 
bilization, we need to seek nonconvex Lyapunov candidates. Recall that any stable 
linear time-invariant system admits a quadratic Lyapunov function. It is thus natural 
to extend from quadratic to nonquadratic via proper composite quadratic functions. 
In the literature, there are various kinds of composite quadratic functions, for exam- 
ple, the maximum (piecewise) quadratic functions 

< ax (x) = msx{x T Pix, ...,x T P k }, (4.28) 

the convex hull quadratic functions 

Yi>0 / \~1 

V*(jc) = min x T l 22,Vi p i) x > ( 4 - 29 ) 

and the minimum quadratic functions 

V^(x)=mw{x T P lX ,...,x T P k x}, (4.30) 

where A: is a natural number, and P\,...,P^ are symmetric and positive definite 
matrices. All these functions are positive definite and homogeneous of degree two, 
and both the maximum and the convex hull quadratic functions are convex. The 
minimum quadratic functions, which we will call min functions for simplicity, are 
nonconvex. This indicates the possibility that the class of min functions is poten- 
tially powerful in addressing the problem of stabilization. Fortunately, this is indeed 
the case, and we are able to prove the following theorem. 

Theorem 4.19 Suppose that the discrete-time switched linear system is exponen- 
tially stabilizable. Then, there exist a natural number k and positive definite real 
matrices P\, ,.., P\ such that the min function of (4.30) is a switched Lyapunov 
function of the system. 

To prove the theorem, we need some technical preparations. The discrete-time 
switched system is given by 

x{t+Y) = A a(f) x{f). (4.31) 
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Let Qi, i = 1, . . . , m be positive definite matrices. Define the ith running cost to be 

L(x, i) — x Qix. 
The total cost w.r.t. a switching signal is 

J(x, a) = ^L((/>(f; 0, x, o),o{tj), (4.32) 

t=o 

which is nonnegative and possibly infinite. The optimal cost is defined to be 

V*{x)= inf J{x,a). (4.33) 

aeS 

It has been established that the optimal cost is finite for any initial state iff the 
system is exponentially stabilizable, and in this case the optimal cost is continuous 
[220]. The problem of switched linear quadratic regulation (SLQR) is to find, if any, 
a switching law that achieves the minimal cost. 

For any mapping V : R" i-> R+, define the operator £ [V] to be 

i;[V](x) = mf{L(x,i) + V(A iX )\, (4.34) 

ieM 

which is called the one-stage cost iteration of the SLQR problem. The composition 
of the operator could be defined iteratively by 

r k+i [V](x) = r[i; k [V]](x), £=1,2,.... (4.35) 

To approach the optimal cost, for a natural number k, we define the k-step cost 
function by 

fc-i 

V k (x)= inf y\L(<p(t\0,x,o),o{t)). 
<reS [(U _i] t=Q 

In particular, let Vo(x) — for all x eR n . 

According to the standard theory of dynamical programming, we have the fol- 
lowing result, which can be found in [26]. 

Lemma 4.20 We have the following statements: 

(i) V k (x) = Z k [V ](x)forall keN + andxe R". 
(ii) lim^ +00 V k (x) = V*(x) for all x € R". 
(iii) ^[V*](x)^V*(x)forallxeR n . 

The equality in Item (iii) is the well-known Bellman equation. Furthermore, there 
is a state-dependent switching law a(t) — \[r(x(t)) such that 

L(x,f(x)) + V*(A f(x) x) = V*(x) VieR". (4.36) 
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Suppose that the switched linear system is exponentially stabilizable. Then, it 
can be seen that 

B 2 

qx T x < V*(x) < x T x Vx e R", (4.37) 

H - w - (l- e -«) 

where a and 6 are as in Definition 4.1, and 

q = min{Vin(2i), ■ ■ ■ , Vin(Gm)}- 

On the other hand, it follows from (4.36) that there exists a positive real number S 
such that 

mmV*(Aix)-V*(x)<-Sx T x. (4.38) 

ieM 

As a result, the function V* is a switched Lyapunov function of the switched system. 
Furthermore, we have the following result. 

Lemma 4.21 Suppose that the switched linear system is exponentially stabilizable. 
Then, there is a natural number K such that Vj. is a switched Lyapunov function of 
the switched linear system for any k > K. 

Proof Fix p. e (0, S), where S is as in (4.38). Note that, for any x 6 R", we have 
0= Vq(x) < Vi(x) < V 2 (x) < ... < V*(x). 

It follows from (4.37) that 

«2 
qx T x < V k (x) < x T x VxeR", k > 1. (4.39) 

By Item (ii) of Lemma 4.20, for any state x with unit norm, there is a natural number 
j x such that 

V*(x)-V k (x)<p/2 Wk>j x . 

Due to the continuity of V* and Vjt, there is a neighborhood of x, denoted A^, such 
that 

V*(y)-V k (y)<p. Vk>j x , y e N x . 

As the unit sphere is compact, it follows from the Finite Covering Theorem that 
there exist a natural number i and states x\ , . . . , x; with unit norm such that 



LK= H i 



Taking K — max{/ V| , . . . , j Xj }, we have 

V*00 - V/tOO <n Vy GHi, k> K. (4.40) 
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Taking advantage of the homogeneity of both V* and V k , we have 
imnVk(Aix) - V k (x) 

i&M 

= min Vk(Aix) - min V*(A t x) + V*(x) - V k (x) + min V*(A t x) - V*(x) 

ieM ieM ieM 

<-{&-H)x T x Vk>K. (4.41) 

This, together with inequality (4.39), clearly shows that V k is a switched Lyapunov 
function of the switched system when k> K. □ 

To connect V* and Vjt with min functions as in (4.30), we define the mapping 

Z i (P)=Q i +AjPA i , 

where P is symmetric and positive definite. Furthermore, given a set of real sym- 
metric matrices y = {P\, . . . , P{\, define the switched Riccati mapping to be 

2Q9 = {Zi(P/):i = l,...,m, j = l,...,l}. 
Finally, define the sequence of matrix sets by 

Zo — {%xn}, 

Zj=Z(Zj-i), 7 = 1,2,.... 

Clearly, the elements of Zj are positive definite matrices for j > 0, and Zj consists 
of up to m' elements. The following result is a simple yet useful observation that 
leads to further insight into the SLQR problem. 

Lemma 4.22 V k (x) = min{jt 7 >jt : P e Z k }fork = 0, 1, 2, ... . 

Proof We proceed by induction. The equality clearly holds when k — 0. Suppose 
that the relation holds for a general integer k. Then, by Item (i) of Lemma 4.20, we 
have 



Vjt+lOO = ttVkKx) = inf {L(x, i) + V k (A iX )} 



ieM' 



= min(x r Qtx + min{(A,x) r i > (A,x) : P e Z k )) 

— min x T (Qi + AjPAAx — min x T Px, 

ieM,PeZ k PeZ k+1 

which completes the proof. □ 

Proof of Theorem 4.19 Simply combining Lemmas 4.21 and 4.22 leads directly to 
the conclusion. □ 
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Theorem 4.19 implies that, when the switched linear system is exponentially 
stabilizable, the system always admits a switched Lyapunov function that is a min 
function. This exhibits that the class of min functions is universal in characterizing 
the problem of stabilization. From an invariant set point of view, this indicates that 
a generally nonconvex level set (of a nonconvex switched Lyapunov function) could 
be effectively approximated by unions of a finite set of ellipsoids. This also strength- 
ens and generalizes the connection between linear systems and quadratic Lyapunov 
functions, which is insightful and powerful in system analysis and synthesis. 

Suppose that Vk(x) — min{x T Px : P e Zk} is a switched Lyapunov function. 
Then, it can be seen that an exponentially stabilizing switching law is 

ait) = argminf min x T (t)(Qi + Af PAi)x(t)}. (4.42) 

i yPeZ k v ' I 

When there are two or more indices achieving the minimum, then just take any one. 
Alternatively, define the state partitions 

Q l : = \x: min x T (Qt + AjPAj)x= min x T (Q f + A] PAj)x\. (4.43) 
I PeZ k ' jeM,PeZ k ' J \ 

It is clear that C2j is a (possibly empty) cone that is not necessarily to be convex. In 
addition, the union of the partitions cover the whole state space. In terms of the state 
space partitions, the stabilizing switching law could be given by 

o(t) = <xgmm{x{t) eQi). {AAA) 

Lemmas 4.21 and 4.22 indicate a constructive approach for computing a switched 
Lyapunov function. For this, we first need to compute the matrix set Z\ and then 
verify whether or not the corresponding min function is strictly decreasing along 
the unit sphere. Note that the number of elements in Z& is up to m k , which is huge 
when k is large. To produce a practically implementable computational procedure, 
we need to further reduce the computational load, as discussed below. 

A min function could be equivalently expressed by two or more sets of min- 
imal piecewise quadratic functions. To be more precise, suppose that matrix sets 
{Qi,...,Qi} and {*i Rj] satisfy 

minjx Q\x, . . . , x Qfx} — min{x R\x, . . . ,x Rjx} Vx e R". 

Then, it is clear that the two matrix sets represent the same min function, and the 
two sets are said to be equivalent. In particular, given a matrix set Q, if a subset 
Q C Q is equivalent to Q, then any element in Q — Q is redundant, which could 
be pruned out. A subset with least cardinality that is equivalent to Q is said to be 
a minimum equivalent subset. A matrix set could admit more than one minimum 
equivalent subset. While it is usually hard to find a minimum equivalent subset, we 
could prune out a redundant element using the following proposition. 
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Proposition 4.23 For a matrix set {Qi, . . . , Qi}, an element Qj is redundant if 
there are nonnegative real numbers ce s with £^ s j .- a s = 1 and such that 

Proof Straightforward. □ 

The verification of the proposition is a convex optimization problem, and it ad- 
mits numerically efficient algorithms. 

Note that matrix set Z% is defined in a recursive way. Therefore, the pruning 
process should be implemented in each iterating step. In this process, it is crucial 
that useful information could be preserved. This indeed is the case, as shown in the 
following proposition. 

Proposition 4.24 Suppose that Z\ is an equivalent subset of Zk. Then, Z(Zt) is an 
equivalent subset of Zk+i. 

Proof It is clear that an element of -Zjfc+i is of the form Qi + Aj PAj , where P e Z^ 
and i e M. For arbitrarily given x e R", let y = A,x. As Z\ is an equivalent subset 
of Zk, there is a matrix P e Z& such that 

y T Py<y T Py, 

which implies that 

x T (Qi + AjPA,)x < x T {Qi + AjPAi)x. 

Since (Qi + Af PAj) e Z(Zk), the conclusion follows due to the arbitrariness 
of*. ' □ 

With the help of the above propositions, we can outline a pruning procedure for 
removing the redundant elements from sets Z^ and obtaining the equivalent subsets 
with smaller cardinalities. 

Pruning Procedure for Calculating Zk 

1. Set£:=0and;y:={0}. 

2. Compute 3>= ZQT). 

3. Prune y by applying Proposition 4.23 and set the resultant set to be y. 

4. Set k := k + 1 and y := j). 

5. If k — K, set Zk '■— y and stop. Otherwise, go to Step 2. 

Example 4.25 For the planar discrete-time two-form switched linear system with 



Ai = 



-1.2299 0.9390 
1.6455 -1.1496 



A 2 = 



2.6229 0.0564 
2.3756 -0.5879 



it can be verified that both subsystems are unstable. 
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Table 4.1 Cardinalities of 
Z k 's 



k 


1 


2 


3 


4 


5 


6 


7 


# 


2 


4 


6 


9 


10 


12 


14 



To apply the optimization approach, we need to calculate the cost-to-go func- 
tions. For this, let Q\ — Q2 — I ■ By the pruning procedure, we obtain Zk for 
k — 1, . . . , 7. Table 4.1 shows the cardinalities of these sets. It is clear that the 
pruning algorithm successfully removes many redundant elements. For example, 
Z% contains 128 matrices, while Z% contains only 14, which is only one ninth of the 
former. 

Next, we examine the qualification of Vk's as switched Lyapunov functions. For 
this, we verify the relationship 

min x T (Qt ■ + Aj P Ai)x < min x T Px VieHi 
ieM,PeZ k ' PeZ k 

for i — 1,2, ... and find that the relationship holds for k — 5. Therefore, V&, 
k — 5, 6, ... , are switched Lyapunov functions for the switched linear system. As a 
result, the switched system is exponentially stabilizable, and a stabilizing switching 
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Fig. 4.3 The cost-to-go functions 
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Fig. 4.4 A sample phase portrait 



law can be obtained by means of (4.42) or (4.44). Figure 4.3 shows the cost-to-go 
functions Vj along the unit circle. To be more precise, let 6 be an angular in [0, it], 
and x — [sin(0), cos(0)] r . The figure shows V# along x through 6. It can be seen 
that, as k becomes larger, Vk — Ffc-i becomes much smaller, that is, the differences 
between Vk and Vk-i approach zero. 

To further present the simulations, we fix Vg as the switched Lyapunov function. 
Figures 4.4 and 4.5 depict a sample phase portrait (with xq — [0, l] r ) and the level 
set {x : V(,(x) — 1}, respectively. It is clear that the state trajectory converges to zero 
exponentially, and the level set is the union of a set of ellipsoids. Finally, Fig. 4.6 
shows the state space partitions, where each partition is a cone. 

Finally, we briefly discuss the continuous-time case. While technically more in- 
volved, the optimization approach is applicable to continuous-time systems, which 
yields exactly the same conclusion as in Theorem 4.19 [192]. As a result, the set of 
min functions is universal in providing switched Lyapunov functions for exponen- 
tially stabilizable switched linear systems. To develop a computational procedure for 
calculating a min function as a switched Lyapunov function, we could first convert 
the continuous-time switched system into a discrete-time switched system by sam- 
pling and then implement the pruning procedure for finding a switched Lyapunov 
function. We demonstrate this by a numerical example. 
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Fig. 4.5 The level set of V 6 



Example 4.26 For the continuous-time two-form switched linear system with 



A,= 



0.2341 


-0.9471 


-1.0559 


0.0215 


-0.3744 


1.4725 


-1.0039 


-1.1859 


0.0557 


-1.2173 


-1.3493 


0.1286 


-0.0412 


-0.2611 


0.6565 



-1.1283 0.9535 



-1.1678 



it can be verified that both subsystems are unstable. 

Taking the sampling period as r = 0.2 sec, we convert the continuous-time 
switched system into the discrete-time switched system 



z(k+l) = B Qik)Z (k), 



z(0)=x , 



where 5, = e A ' T , i — 1, 2, and q is the switching signal with g(k) — u(kr), k — 
0,1, When the switching signal of the original system satisfies 



a(t) = a(kx) Vk = 0,1,2,..., t e [kt, (k+ 1)t), 
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Fig. 4.6 State space partitions 



we have z(k) = x(kr) for k — 0, 1 , In this case, state z(-) is a sampled trajectory 

of the original system with the same initial condition. 

Let <2i = Qi — I. Applying the pruning procedure to the sampled system, 
we obtain Z^ for k — 1, . . . , 5. While Z<=, contains 32 matrices, Z$ contains 24. 
Furthermore, it is numerically verified that V5 is a switched Lyapunov function 
for the sampled switched system. As a result, the sampled system is exponen- 
tially stabilizable, and the original continuous-time system is also exponentially 
stabilizable. Figure 4.7 depicts the level set {x : Vs(x) = 1} on the unit sphere 
x — [cosf?i, sin 0i cos 62, sin^i sin^] 7 ^ 0\, #2 £ [0, 2jt). It can be seen that the level 
set is the union of a set of ellipsoids and is nonconvex. 

Next, fix the initial state xo = [0, 1, — l] T ■ To find a switching signal that steers 
the original system exponentially stable, we need to calculate a stabilizing switching 
signal as in (4.42) for the sampled switched system. Then, a stabilizing switching 
signal for the original continuous-time system is given by 

a{t) — Q(kr), t e[kr,(k+l)r). 

Figures 4.8 and 4.9 depict the switching signal and the corresponding state trajec- 
tory, respectively. It is clear that the state trajectory exponentially converges to zero 
at a satisfactory rate. 
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Fig. 4.7 The level set of V5 on the unit sphere 
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Fig. 4.8 Switching signal 
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Fig. 4.9 State trajectory 



4.3.4 Well-Definedness of State-Feedback Stabilizing Law 

A state-feedback switching law can be described by 

o{t) = <p(x(t),a{t-)) 

and is said to be pure-state-feedback when cp does not explicitly rely on a(t— ). 
Note that, as any asymptotically stabilizable system admits a switched Lyapunov 
function (cf. Theorem 4.10), a state-feedback stabilizing switching law can be con- 
structed as in (4.11) or (4.13) by means of the Lyapunov function. However, it 
should be stressed that, while state-feedback switching laws are universal in sta- 
bilizing switched systems, they are not always well behaved due to the fact that 
a well-defined state-feedback switching law for a nominal switched linear system 
may produce chattering (Zeno) phenomenon for a slightly perturbed system. We 
show this through a numerical example. 

Example 4.27 Consider a perturbed switched linear system given by 
x(t) = A a x(t) + f a (t), 









1 



1 
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-1 



fl(0 = -f2(t): 



1 



01r , (4.45) 



where f\ and f% are perturbations associated to the first and second subsystems, 
respectively. 

It can be easily verified that the function V(x) — \(x\ + X%) is a switched Lya- 
punov function for the nominal system. A stabilizing switching law can be con- 
structed as follows. 

First, define the regions 

£2, = jieR 2 : V\a, <~nV(x)}, r = 1,2, 

where r;, i = 1, 2, are nonnegative real numbers. It can be seen that the union of the 
regions cover the total state space if r, < 1 for i — 1, 2. A hysteresis switching law 
can be defined recursively as 

<0 = 0, 

a (to) = arg min {x^ Q t x } , 

tk+i = inf{f > t k : x(t) $ tta(t k )}, (4 - 46) 

fl, a(tt) = 2, 
tr(ft + i)=| it = 0,1,2,.... 

[2, er(tt) = l, 

This switching law stabilizes the nominal switched system, and it can be seen that 
the switching law is well defined for the nominal system. 

For the perturbed system, suppose that we use the state-feedback switching law 
(4.46) with r\ — r2 — 0.4. Figure 4.10 depicts the state trajectories and the number 
of switchings starting from x(Q) — [1, — l] r . It can be seen that the chattering phe- 
nomenon occurs when t > 11.45 sec. In fact, as the state converges to the origin, 
the information of the state is "merged" by the perturbations, that is, ;' vij — ► +oo. 
Because the state direction and the perturbation direction are always opposite, chat- 
tering occurs. 

The example clearly exhibits that a well-defined state-feedback switching law 
might loss its well-definedness if the system is slightly perturbed. This indicates that 
state-feedback switching laws might not be appropriate for achieving both stability 
and robustness. 



4.4 Stabilization via Mixed-Driven Switching: Aggregation and 
Calculation 

In this section, we focus on stabilizing switching design for the switched linear 
system 

x+(t) = A a(t) x(t), (4.47) 
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Fig. 4.10 State trajectories and switching numbers of system (4.45) 

where x(t) e R", o(t) e {1, . . . , m}, and A\, ..., A m are known real constant ma- 
trices. 

The objective is to find, if possible, a switching law that achieves (i) stability, 
(ii) robustness against exterior perturbations including structured, unstructured, and 
switching perturbations, and (iii) well-definedness for the nominal system and the 
perturbed system. 

As discussed in the previous sections, time-driven switching laws are not univer- 
sal for the problem of stabilization, though its well-definedness is clear as it is inde- 
pendent of the system dynamics. State-feedback switching laws, on the other hand, 
are universal, but the well-definedness is sensitive to system perturbations. This mo- 
tivates us to find a new switching law that achieves the merits of both schemes while 
getting rid of the demerits. The pathwise state-feedback switching law proposed be- 
low is exactly such a switching law. 



4.4.1 Pathwise State-Feedback Switching 



Suppose that the switched system is not consistently stabilizable. This means that 
any single switching path could not make the total state space contractive. However, 
it is still possible that a switching path makes a subset of the state space contractive. 
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For simplicity, we assume that two switching paths, p\ over [0, T\) and p2 over 
[0, T2), make regions Q\ and Q2 contractive, respectively. To be more precise, we 
have 

\<t>(Ji\0,x,p{)\ < \x\ Vi e i2 ; , i = 1,2. 

Moreover, assume that Q\ U Q2 — R"- We further assume without loss of generality 
that Q\ fl i?2 = 0, otherwise just redefine £?2 = R" — &i ■ With these in mind, we can 
construct a stabilizing switching law a as follows. For any initial state xo — x(to), 
let the system operate along switching path p\ if x belongs to Q\, otherwise let the 
system operate along switching path p2 . Define 

io = aig{xo ef2j], 

h = to + Ti Q , 
<r xo (t) = pi (t-to) Vte[t ,h), 
xi =4>(Ti ;0,xo,Pi ). 

It is clear that |jci| < \xo\. Starting from time t\ at x\, let the system operate along 
switching path p\ if x\ belongs to f2\, otherwise let the system operate along 
switching path p2 ■ Define accordingly 

z'l = arg{xi eQj], 
tl = t\ + T h , 



v x °(t) = Ph(t-h) Vte[t u t 2 ), 



X2 = <P(Ti 1 ;0,xi,pi 1 ). 



Repeating the process in the same manner, we obtain the switching signal a x ° over 
[0, +00) such that 

\xk+l\ = \<t>{tk+i;t ,x ,a xo )\ 

< \4>(tk;to,xo,a xo )\ = \xk\, k = 0,l,.... 

Let xo vary among the state space, we obtain a switching law that makes the 
switched system stable. 

For any initial state, the above switching law generates a switching signal that 
concatenates switching paths p\ and p2 through the state measurement at the con- 
catenating instants. Therefore, the switching mechanism is mixed time-driven and 
state-feedback. It is clear that the switching law is well defined if both p\ and P2 are 
well defined, and the well-definedness is independent of the subsystem dynamics. 
On the other hand, as a state-feedback mechanism is incorporated, the switching 
law can accommodate the initial state and exotic perturbation information, and it is 
expected to have some flexibility in achieving both stability and robustness. 
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We are ready to formally describe the switching law, which will be termed as the 
pathwise state-feedback switching law. 

Suppose that k is a natural number, £2,, i = 1, . . .,k, are regions in R" satisfying 
ULi &i = R" and Q t n S2j = for any i ^ j, and 0; : [0, s ( ] h+ M, i = 1, . . . , k, 
are well-defined switching paths. The pathwise state-feedback switching law via Qi 
and B\ w.r.t. system (4.47), denoted by /\, =1 0- ' , is the concatenation of switching 
paths {0(}j_j through {^/}f =1 as defined below. For any initial state x(to) —xq, the 
generated switching signal a x ° is recursively defined by 

ik = arg{xk ef2;}, 

tk+[ — tk +Si k , 

(4.48) 
(r x °(f) = e ik (f-tk) Vt&[t k ,tk+i), 

Xk+i =<P(si k ;0,Xk,6i k ), k = 0, 1,2, .... 

It is clear that the pathwise state-feedback switching law is always well defined 
over [0, +oo) for any initial state. As each generated switching signal is a concate- 
nation from paths {0/}f_i, the switching law can be equivalently represented by the 
set of sequences 

{(x ;io,ii,...): x eR n }, 

where /o, h, ... are defined as in (4.48). Note that the switching law is indepen- 
dent of the permutation of Qj and 0, , provided that the pairwise relationship keeps 
unchanged. 

Note also that each switching path Q[ corresponds to a state transition matrix 
d — <P(sj,0, 9j) with the property that cj>(sj; 0, x, 0,-) = G,x for all x G Q{. 

Lemma 4.28 Switching law A;= l fy ' asymptotically stabilizes switched linear sys- 
tem (4.47) iff the discrete-time piecewise linear system 

z(t + l) = Giz(t), z(t)etti, (4.49) 

is asymptotically stable. 

Proof From the definition of /\f_j 0- ' it is clear that 

xj = <j>(tj\ 0, xo, (T x °) = z(j), j = 0, 1, 2, ... , 

where tj and Xj are defined as in (4.48), and z(j) is the state of system (4.49) with 
z(0) — x(0). As a result, each state trajectory of (4.49) is exactly a sampled state 
trajectory of the original switched system (4.47) at specified sampled instants. This 
implies the "only if" part of the lemma. On the other hand, it can be seen that, for 
any t e (tj, ?/+i), we have 

\4>(t;0,xo,(r*>)\<Ti T \4>(tj;0,xo,(r* )\=ri T \z(j)\, 
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where T — max,- 6 Af si, r\ — maXj e M exp(||A,-||) in continuous time, and n — 
max, e M II Aj || in discrete time. This, together with the asymptotic stability of system 
(4.49), guarantees that the original switched system (4.47) is asymptotically stable 
under switching law /\ i=1 9 i ' . □ 

For clarity, we term the discrete-time switched system (4.49) as the aggregated 
system of the original system (4.47) w.r.t. { (#, , Qi ) } i= j . It is clear that each pathwise 
state-feedback switching law corresponds to an aggregated system, and the switch- 
ing law stabilizes the original system iff the aggregated system is asymptotically 
stable. 

Lemma 4.28 indicates a way to find a stabilizing switching law for the switched 
linear system. Indeed, if we can find a number of switching paths 9j and a set of state 
partitions Q[ that make the aggregated system asymptotically stable, then the orig- 
inal system is stabilized by the pathwise state-feedback switching law /\ j=l 9 i '. 
For this, we need to find the switching paths and the state partitions at the same 
time, which may be not an easy task. To reduce the complexity, observe that, if 
the switching paths 9j are properly designed in the following sense, then the corre- 
sponding state partitions can then be determined accordingly. 

Lemma 4.29 Suppose that V is a continuous positive definite function defined on 
R" and that 9j, i — 1, . , . , k, are switching paths defined over [0, Sj), respectively. 
Then, switched system (4.47) is asymptotically stabilizable if 

k 
minV ((pisi; 0, x, 6i)) <V(x) VieR",i/0. (4.50) 

The proof of the lemma is immediate as condition (4.50) implies that the aggre- 
gated system 

z(t + l) = G iZ (t), z(t)eQi, 

with Gj — <P(si, 0, Qj) is asymptotically stable. In this case, let 

*2i = {x: V(<t>(si;0,x,9i))=miRV(<j>(si;0,x,di))} (4.51) 

and 

r k , ;-; 

£2j = \x: V(((>(sj; 0,x,9j)) = mmV(<p(si;0,x, 0,-)) - (J Q\ (4.52) 

i=i 

for j — 2, . . . , k. It can be seen that the pathwise state-feedback switching law 
/\i-i 9 1 ' asymptotically stabilizes the original system. 

Lemma 4.29 enables us to design the switching paths instead of designing both 
the switching paths and the corresponding state-space partitions, as indicated by 
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Lemma 4.28. Note that, if V is O-symmetric and positively homogeneous of degree 
one, i.e., 

V(Xx) = \X\V(x) VieR", XeR, 

then the state-space partitions C2j as defined in (4.51) and (4.52) are O-symmetric 
cones, i.e., 

x & Qj «=>• \xe£2j Vx, i,Xj^0. 

Therefore, the resultant pathwise state-feedback switching law /\, =1 0- ' for the 
nominal switched linear system is radially invariant in the sense a x — o Xx for any 
x e R" and X^Q. This further implies that the state trajectories are radially linear, 
i.e., 

<j>(t,0,Xx,j\d?' ) =X<j>lt;0,x,f\e? i J VxeR", XeR. (4.53) 

The above discussion encourages us to look for an origin-symmetric and posi- 
tively homogeneous function serving as the Lyapunov function in Lemma 4.29. For 
this, note that vector norms are natural candidates. A question that arises is whether 
the existence of such Lyapunov functions is universal or not. The following theorem 
presents a confirmative answer. 

Theorem 4.30 Let \ ■ \ be any vector norm in R n , and p, be any real number with 
< j± < 1 . Suppose that switched linear system (4.47) is switched attractive. Then, 
there exist a natural number k, positive times si > for i — 1, . . . , k, and well- 
defined switching paths B\ over [0, Si) for i — 1, . . . , k such that 

min|0Cs,;O,Jc,6»,)| < fi\x\ VxeR". (4.54) 

Proof Note that relationship (4.54) implies (4.50) with Vix) — \x\. As the norm is 
positively homogeneous of degree one, (4.54) holds if it holds for the unit sphere, 
i.e., 

k , . 

rmn\4)(si;0,x,di) \<n VxeHi. (4.55) 

1=1 

Fix x e Hi . It follows from the switched attractivity that there exist a positive 
time t x and a well-defined switching path 6? fY , such that 

\4>(t x ;0,x,e x )\<^. (4.56) 

In terms of the transition matrix, it follows from (4.56) that 

1 y ' l_ 2 
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As a result, there is an open neighborhood Af x of x such that 

\cp(t x ,0,6 x )y\<p WyeAf x . (4.57) 

Letting x vary along the unit sphere, it is obvious that 

veH] 

As the unit sphere is a compact set in R" , by the Finite Covering Theorem, there 
exist a natural number k and a set of states x\ , . . . , Xk on the unit sphere such that 

k 
lJJV^2Hi. 

»=i 

Accordingly, we can partition the unit sphere into k regions M \ , . . . , Mk such that 

(a) U?=i Mi = Hi, and Mi n Mj = for i ^ j and 

(b) x, e Mi for any i — 1, . . . , k, and 

| <P (t Xi , 0, 6 Xi )y\<ii VyeMi. (4.58) 

Let St — t x ' and 0' — 6 Xi . It is clear that relationship (4.58) implies (4.55), and the 
theorem follows. □ 

Corollary 4.31 For the switched linear system, the following statements are equiv- 
alent: 

(1) The system is switched attractive. 

(2) The system is asymptotically stabilizable. 

(3) The system is exponentially stabilizable. 

Proof Suppose that the system is switched attractive. It follows from Theorem 4.30 
that, there exist switching paths 9L ,, i — 1, . . . , k, such that the aggregated sys- 
tem (4.49) is exponentially stable. In fact, let zq, Zi, ■ ■ . be a state trajectory of the 
aggregated system. It can be seen that 

\zj\<p j \zo\, 7=0,1,.... 
Back to the original system, it is clear that 

1 tj ; 0, zq, j\ 0°' J = Zj Wj = 0, 1, 2, . . . , (4.59) 

where C2j and t, are given in (4.51)-(4.52) and (4.48), respectively. 
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Let h — maxfii, . . . ,s/i},a — — ^, r\ — max{||Ai||, . . . , \\A, 
continuous time and fi — rf in discrete time. It can be seen that 



! , . . .,Sk}, a — — l -^, r\ — max{||Ai||, ... , ||A m ||}, and /J = e hr) in 
h 



<t>lt;0,xo,/\e, 



Ql 



( = 1 



tj + i;Q,x ,/\0: 



12, 



( = 1 



= £|z 7 - + i|<^' +1 |*ol<^ 



-a(j+l)h 



-vol 



<pe- a '\x \ Wte[tj,t j+ i), j = 0,1,2,..., 

which clearly exhibits that the original system is exponentially stable under the path- 
wise state-feedback switching law /\, =1 9 t ' . This concludes the proof. □ 

Theorem 4.30 reveals a couple of important facts, which are listed below as re- 
marks. 

Remark 4.32 The most important implication of the theorem is that the class of 
pathwise state-feedback switching laws is universal for the purpose of stabilizing 
design of switched linear systems. Indeed, suppose that switching paths 9L > sat- 
isfy relationship (4.54). Let the state-space partitions C2j be 

Q x = \x: \4>(si;Q,x,d\)\ =min|(/>(.s,-;O,x,0,-)||, 

, j-i 

S2j = \x: \4>{sj\0,x,ej)\=mm\4>{si-,0,x,6i)\\-\j£2i, (4 °° ! 



i=i 



7=2, 



,k. 



Then, the pathwise state-feedback switching law /\ i=l 8j ' exponentially stabilizes 
the switched linear system. As a result, the aggregated system (4.49) is exponentially 
stable. 

Remark 4. 33 It should be noticed that number k is independent of the number of the 
subsystems, m. As can be seen in the proof of Theorem 4.30, it relies on the norm 
and the particular choice of the contractive switching paths for the state on the unit 
sphere. Due to the nonconstructiveness of the Finite Covering Theorem, we do not 
have a general upper bound of number k, though it is indeed a finite number. The 
same comment applies to the lengths s, of the switching paths 6' . Nevertheless, for 
any consistently stabilizable system, it is always possible to find a single switching 
path that makes the unit sphere contractive, and thus the system admits a linear time- 
invariant system as its aggregated system. Here we present an example to show how 
k varies w.r.t. the norm. 

Example 4.34 For the continuous-time switched linear system 

x(t) = A a(t) x{t), a(t)e {1,2}, 
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A 2 : 



1 -€ 

6 1 



1 
-6 



where e is a positive real number, it can be verified that the system is switched 
attractive and hence is exponentially stabilizable. 

For the standard Euclidean norm, it can be seen that the contractive cone for the 
second subsystem is contained in the region 

fli = {Wl-€ 2 |*i|<e|x 2 |}. 

Note that, for any initial state outside the cone, the stabilizing switching law that 
achieves the largest possible convergence rate is to activate the first subsystem until 
the state reaches region Q\. To steer the state xo = [ '] to region £2i, it needs at 

least time h > — ~ a ^ csln(< ^ | which tends to infinity as e approaches 0. At the same 
time, any states x\ and x 2 on the unit sphere can be steered to region Q\ by a single 
switching path only if they can be simultaneously steered to the region by activating 
the first subsystem. This means that to steer the whole unit sphere into region Q\, 
we need at least N — l j!ackn(e) ~\ ~ ^ switching paths, where \a~\ denotes the least 
natural number greater than or equal to a . It is clear that N approaches infinity as e 
approaches 0. 

On the other hand, if we take the norm as |x| = Js 5 x^ + x|, it can be verified 

that the region J2 2 = {x: 2e 2 |xi| < |x 2 } is contractive under the switching path 
2[u„si)> where s\ = \ min{l, e}. For any state outside the region, it can be verified 
that the switching path 2[0, S1 ) A l[o,s 2 ) makes the state contractive, where A denotes 

the concatenation of switching paths, and s 2 = 2arctan(2e 2 ). As a result, k = 2, 
and Si, i — 1, 2, are small for small e. 

Finally, we present the following definition which is motivated from Theo- 
rem 4.30. 



Definition 4.35 Suppose that | ■ | is a given vector norm. A pathwise state-feedback 
switching law /\,_j ft ' is said to be piecewise contractive w.r.t. the switched linear 
system and the norm if 

\<p(si;0,x,ei)\ <\x\ Vx eS2 t , x^O, i = l,...,k. 

4.4.2 Computational Algorithms 

Theorem 4.30 establishes that pathwise state-feedback switching laws are universal 
in achieving exponential stability of switched linear systems. To solve the stabiliza- 
tion problem, we need to develop a constructive procedure for computing a pathwise 
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state-feedback switching law that stabilizes the switched linear system. In this sub- 
section, we present several algorithms for calculating a stabilizing switching law. 

The following procedure summarizes the main steps toward the construction of 
a stabilizing switching law. 

Conceptual Procedure for Finding a Stabilizing Switching Law 

1. Fix a vector norm | • | and a real number fi e (0,1). For each state x in the unit 
sphere, find a time t x and a switching path 6f Q fX , such that 

\<p(t x ,0,x,9 x )\ <ii. 

2. By the Finite Covering Theorem, there exist a finite natural number k, a state set 
{xi,...,Xk}, and a partition of state space {J2i , . . . , Q^} such that 

k 

i=\ 
and 

\<p(t Xi ,0,x,6 Xi )\ <n\xi\ VxeQi, i = l,,..,k. 

Denote 0; = 6 Xi for i = 1, ..., k. 

3. The state-feedback pathwise switching law /\,_j 0- ' exponentially stabilizes the 
switched system. 

It can be seen from the procedure that, while Step 3 is implementable online by 
means of a timer and a state-measure device, Steps 1 and 2 are generally not con- 
structive. To tackle this problem, we propose an alternative procedure to find k, 0; , 
and Qi simultaneously. 

First, we show that, for any asymptotically stabilizable continuous-time switched 
linear system, it is always possible to find a positive sampling period such that 
the sampled system is also asymptotically stabilizable as a discrete-time switched 
system. Note that a pathwise state-feedback switching law for the sampled sys- 
tem can be converted into a pathwise state-feedback switching law for the original 
continuous-time system in a clear manner. As a result, the design procedure of a 
stabilizing switching law for both continuous-time and discrete-time systems can 
be presented in a unified manner. 

Lemma 4.36 For an asymptotically stabilizable continuous-time switched linear 
system 

x(S) = A a(f )x(t), a{t)eM, 

there is a positive real number p such that for any sampling period T < p, the 
sampled switched system 

y(t+l) = B eit) y(t), Q(t)eM, B t = e A ' T (4.61) 
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is also asymptotically stabilizable . 

Proof Suppose that /\*_j 9 t ' is a stabilizing switching law for the continuous-time 
system with 

|0(s,-; to,x,9i)\ < fi\x\ Vxe&i, i = l,...,k, 

where [i < 1 . Rewrite the inequality as 

\e J '-- [ ■■■<? J o ' °x\<n\x\ Vie Q u i= l,...,k, (4.62) 

where to — t' < t\ < ■ • • <//._] and Jq, j[, ..., jl_i are the switching time/index 
sequences of 6>; over [0, Si), respectively, and tj, — s; . Define the functions £; : R'' x 
Qi i->- R for i — 1 , . . . , k by 

Fix jl e (pi, 1). It follows from (4.62) and the continuity of the functions that there 
exists a positive real number p such that 

£j(t|, . . . , x\. ,x) < jl\x\ Vx G Qj, i — 1, .. . , k, 

whenever r' — (f'. — ?'_i) € [0, p], j — I, . . . , U. As a result, when the sampling 
rate T is less than or equal to p, then there are natural numbers v[ , . . . , v\. such that 

|(exp(A ; ,- T)) v '< ■■■(exp(A,r)) y ' 1 jc| < jl\x\ Vxefl;, i = \,...,k. 

This means that, under the sampling rate T, the sampled-data system (4.61) is 
switched attractive and is asymptotically stabilizable. □ 

Lemma 4.36 enables us to focus on the discrete-time switched linear system 

x(t + l) = A a(f )x(t), <r(t)e{l m). (4.63) 

The system can be represented by the m -tuple (Ai , . . . , A m ). 

We can arrange an ordered set of all the possible switching paths and their corre- 
sponding state transition matrices. For example, let 

ft =(1), ..., # m = (rn), 0m+i = (l.l), •••, 02» = (l.m), 

&2m+i = (2, 1), ..., &3 m = (2,m), ..., !? OT 2 +1 = (m, 1), ..., 
& m 2 +m = (m,m), !> m 2 +m+1 = (1,1,1), ..., 

and the corresponding state transition matrices be 

t-l = A] , . . . , C m = A m , C m -|-i^A[, ..., C2m — A m Ai, 
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C2m+i — A\A 2 , ..., C3 m — A m A 2 , ..., C m i +[ — AiA m , ..., 

^m 2 +m=A m , C m 2 +m _|_i = Ay, .... 

The next algorithm presents a schematic procedure for finding the requested pa- 
rameters k, $i , and 42,- , i = 1 , . . . , k. 

Schematic Algorithm for Computing the Parameters 

Initialization. 

(0) Set k :— 0, ContractiveRegion :— 0, j :— 0. Fix jjl in (0, 1). 
Recursion. 

(1) Set 7':= 7 + 1. 

(2) Set C :— Cj and compute the singular values of matrix C. If all the singular 
values are greater than or equal to one, then go back to Step (1). Otherwise, 
compute the set Q — {x e R" : \Cx\ < n\x\}. 

(3) If Q C ContractiveRegion, then go back to Step (1). Otherwise, set 

k:=k+l, Q k :=Q, 6 k :=frj, and 
ContractiveRegion :— ContractiveRegion U Q . 

(4) If ContractiveRegion — R", then go to Step (5). Otherwise, go back to Step (1). 
Reduction. 

(5) For i — I, . . . ,k, verify if Qi C [J^ Qi. If yes, set Qi :— Qi+i and 6i :— 6i + i 
for I — i, . . . ,k— 1 and set k :— k — 1. Continue the process until the partition 
is irreducible. 

(6) Finally, set S2 t := Q t - \J\Z\ Qi for i = 2, . . . , k. 

The termination condition ContractiveRegion — R" means that, for each initial 
state x, there exists a region Qj such that x e Q[ and the switching path 0,- that 
makes the region (and the state) contractive. Upon termination of the algorithm, 
Qi and 9, for i = 1 , , . . , k give the state partitions and the corresponding switching 
paths, respectively. 

Note that the algorithm terminates only when ContractiveRegion — R" . That is 
to say, if the switched linear system is not switched attractive, then the algorithm 
will not terminate in a finite time. However, if the system is switched attractive, 
the algorithm does terminate in a finite number of steps, although we do not have 
an upper bound of the step number. Other termination conditions may apply, for 
example, if all the singular values of matrices A\ , . . . , A m are greater than or equal 
to one, then the system is by no means to be switched attractive [213], and we can 
terminate the algorithm in m steps ( j < m). 

In the schematic algorithm, the major computational loads include the determi- 
nation of the regions £?, and the verification of U,-_i &i — R". For this, we briefly 
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discuss the computation of the region Xq — {x e R" : \Cx\ < ll\x\) for a matrix 
C e R nxn and the verification of the relationship 

k 
\Jx C] =R n (4.64) 

7 = 1 

for a matrix set {C\ , . . . , QJ. 

Note that the region Xq is norm-dependent, that is, different norms may corre- 
spond to different regions Xq for a matrix C. Note also that, for the ^2-norm, the 
region is generally nonpolyhedric in nature, that is, it is not a union of a finite set of 
polyhedra. In this case, it is very hard to verify whether or not U ;=i X-c, — R" for 
a matrix set {C\, . . . , C&}. On the other hand, for the I! i -norm, the region is indeed 
polyhedric. Accordingly, we use the ^i-norm. 

Given a matrix C — (c (; ), !X „, it is clear that 



X c =\xeR": £ 



i=i 



/ . c i,J x .i 

7 = 1 



ixj^\xj\ , (4.65) 

7 = 1 > 



which can be routinely converted into the union of a finite number of regions in the 
form 

{x: E { x + Fy <0}, (4.66) 

where E\ and F\ are a matrix and a column vector with compatible dimensions, 
respectively. It is clear that any region in form (4.66) is a convex polyhedron. 

Next, we propose a reduced-order method which enables us to compute the re- 
gion (4.65) and to verify relation (4.64) in a unifying scheme. 

Take the half unit sphere 

H^"-° = { x = [xi,.. .,x n ] T : x n > 0, |x|i = 1}. 
This half-sphere can be projected onto the (n — 1) -dimensional unit ball by the map 

V n : n\"-° ^ B'f 1 , T n x = [xi,.. . ,x„_if. 
The inverse map is 

V- 1 y = [y 1 ,...,y n -i,l-\y\i] T , yeE', 1 " 1 . 
Let 

y c = {yeV\- 1 : ICp-Vlj^lTVVIj}. 
which is also a finite union of regions in form (4.66). It can be seen that 

X c = {rV- 1 y:reR, yey c }. 
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Moreover, given matrices C\, . . . ,Ck, a necessary and sufficient condition for 

U^c, =B?- 1 . (4.67) 

When n — 2, the set yc is the union of several (possibly empty) pieces of in- 
tervals, and the verification of (4.67) is simply of dimension one. Similarly, when 
n — 3, the verification of (4.67) is to check whether the regions cover the pla- 
nar unit ball, which can be conducted conveniently by phase plane portraits. For 
higher-dimensional systems, due to the polyhedric structure of 3^c, an d B"~ > there 
are commercial numerical softwares available (for example, MATLAB GBT Tool- 
box [252]) for computing the regions ^q an d for verifying relation (4.67). 

Integrating the conceptual procedure, the schematic algorithm, and Lemma 4.36, 
we obtain the following constructive procedure for stabilizing switching design of 
the switched linear system. 

Computational Algorithm for Stabilizing Switching Design 

1. Given n,m, and A,- eR" xn fori e M — {I, . . . ,m}. Set flag :— for continuous 
time and flag :— 1 for discrete time. 

2. If flag — 1, then set B,_i := A, for i e M, and r :— 1. Otherwise, choose a 
positive real number r (sampling rate), and let fi,_i :— exp(A,r) for i e M. 

3. Set k :— 0, FeasibleSet :— 0, UnionOfRegions := 0. 

4. Express k in base m, i.e., k = X!;=i ji m '~ l wrm ji e M and j s ^ 0. Set path :— 
[ji,...,j s ] mdC:=Bj s ---B jv 

5. Compute y>c- 

6. If yc <£ UnionOfRegions, set 

FeasibleSet :— FeasibleSet + {(C, path, yc)}, and 
UnionOfRegions :— UnionOfRegions U yc- 
1. If UnionOfRegions ^ B"" 1 , set k := k + 1 and go to Step 4). 

8. Remove the reducible triplet elements of FeasibleSet whose yc 's are subsets of 
the union of the other yc 's (cf. the reduction part of the Schematic Algorithm). 

9. Set k to be the number of elements of FeasibleSet. For i = 1, . . . , k, set G, be 
the C in FeasibleSetii) , pathj be the path in FeasibleSet(i), and A,- be the yc 
in FeasibleSetii.) . 

10. Set A t := A t - \J S Z\ A s fori =2,..., k. 

11. Input an initial state xo and a terminal time tf. 

12. Set State :— 0, IterativeState :— xq, IterativeTime := 0. 

13. Set y :— V n {sgn(lterativeState{n)) * IterativeState /\IterativeState\), find i e 
{ 1 , . . . , k] such that y e A,, and set j := 1. 

14. Set index :— path i (j) + 1 . 

15. Compute the solution [t, x] of the differential/difference equation 

x + (t) = A index x(t) 

over time interval [IterativeTime, IterativeTime + r] and set 
IterativeTime :— IterativeTime + r and 
State :— State U [t , x]. 
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16. If j < lengthipathj), set j := j + 1 and go to Step 14). 

17. If IterativeTime < tt, set IterativeState :— State (IterativeTime) and go to 
Step 13). 

18. Plot the state trajectory State. 



4.5 Stabilization via Mixed-Driven Switching: Robustness 
Analysis 

Suppose that switched linear system (4.47) is asymptotically stabilizable and that 
the pathwise state-feedback switching law /\ i=l 9j Sj ' exponentially stabilizes the 
system with convergence rate a. That is, 



4> f;0,*,/\<< 



<Pe~ at \x\ VxeR",teT (4.68) 



for some /3 > 0. 

Let us consider the situation that the switched linear system undergoes exotic 
disturbances or perturbations. The perturbations can enter either structurally or un- 
structurally and can enter into either the subsystems or the switching signals. A gen- 
eral description of the perturbed system can thus be given as 

X+(t) = (A 5(l) + A 5(t) )x(t) + fa(t)(t) + fo(t), 

where a (t) is the (structural) perturbation of the nominal switching signal, A, and 
/; are the structural and unstructural perturbations on the ith subsystem, respec- 
tively, and fo(t) is the unstructural perturbation of the nominal system. As fo can 
be absorbed by /, in an obvious manner, we can assume that this part is null and 
rewrite the perturbed system as 

x + (t) = (A 5{t) + A 5{t) )x(t) + U it) (t). (4.69) 

The objective of this section is to analyze the robustness of the nominal switched 
linear system w.r.t. the perturbations. For this, note that the structural and unstruc- 
tural perturbations for the subsystems can be handled by the conventional scheme 
of robust analysis in a normed space. The perturbation analysis for switching signal, 
however, is a new topic that needs more attention. 

The study of the robustness against switching signal perturbations is well mo- 
tivated for the reasons below. First, in practice we cannot implement a switching 
signal precisely. For example, time delay is unavoidable in many practical situa- 
tions, and exact online measure of the state variable is usually impossible. Second, 
the switching device may mismanipulate in certain cases. For instance, the system 
should activate the ith subsystem, but it activates the j'th instead. Third, component 
(subsystem) failures lead to displacement of switching paths, and the ability of fault 
tolerance is always an important issue for practical implementation. Finally, from 
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the design viewpoint, we prefer to choose a switching law which still works (for the 
stability purpose) under small perturbations. 

In the next subsection, we present an approach to characterize the distance be- 
tween two switching signals generated by a pathwise state-feedback switching law, 
which paves the way for the robust analysis conducted later. 



4.5.1 Distance Between Switching Signals 

To implement a pathwise state-feedback switching law /\/=i ®\ ' > ^ involves a re- 
peated process of first determining an index j according to the online state mea- 
surement, and then coordinating the switching along the switching path 8/. In this 
process, perturbations might enter either in index determining or in executing the 
switching law. The distance between the nominal switching signal and perturbed 
switching signal should be the summation of the variations of both types in some 
sense. For this, we first define the distance between two switching paths and then 
extend it to the case of pathwise state-feedback switching laws. 

For a right-continuous switching path P[t ,t f ), let to < t\ < ■ ■ ■ < t s be its switch- 
ing time sequence. Its switching index sequence is p(to), p{t\), ,,., p(t s ). For con- 
venience, we refer to the sequence 

ss p = {(t , p(fo)), (h, p(h)), ..., (?,, p(t s )), ...} 

as its switching sequence and the sequence 

DS P = {(p(to), h - to), (p(t\), t 2 -h),..., (p(t s -i), t s - t s -i), ...} 

as its duration sequence. It is clear that p, SS p , and DS p are equivalent in the sense 
that one can determine the others and vice versa. As a result, a variation of a switch- 
ing path means a variation of the switching/duration sequence, which can also be 
seen as a variation of the transition chain defined later. This simple observation 
provides a basic insight into the way for characterizing the distance between two 
switching paths. 

For a switching duration sequence (io, ho), (i\,h\), . .., the transition chain is 
defined as the sequence of state transition matrices at the switching instants, i.e., 

<p(io, ho)\q>(ii,hi)cp{io, ho)\(p{ii, h 2 )<p(ii,hi)(p(io, ho)\ ■■■ , (4.70) 

where <p(i, h) — e A ' h in continuous time, and q>(i, h) — Ar- in discrete time. The 
transition chain clearly exhibits the state transition process along the switching path. 
Before formulating the distance between two switching paths, we present a cou- 
ple of motivating examples. 

Example 4.37 Consider a continuous-time switching signal pi whose switching 
sequence is (0, 1), (1, 2), (2, 1), (3, 2), . . . . 
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Suppose that there is a small time delay e at the first switching time. It is 
obvious that the delayed switching signal p 2 is with switching sequence (0, 1), 

(1 + 6,2), (2 + e, 1), (3 + 6,2), The corresponding transition chains for the 

nominal and perturbed switching signals are 

At I At All At An A, i 

e l \e L e Me l e l e ' • • • 



and 



e M(n e ) le A 2e A 1 (l +e ) le A le A 2e A 1 (l +e ) l 



respectively. It can be seen that the two chains possess the same convergence prop- 
erty, that is, the perturbed matrix chain is convergent iff the nominal matrix chain is 
convergent. However, it is clear that 

Pi(t)^P2(t) Vte0, 

where — UjS t^> k + e). That is, the two switching signals are not equal at time 
intervals of an infinite length no matter how small 6 is. This excludes the reason- 
ableness of formulating the distance between p\ and p2 by measff : p\ (t) ^ p 2 (t)}, 
though this seems to be the most straightforward way. Another observation from 
this example is that, comparing with the switching sequence, the switching duration 
sequence is more suitable for describing the transition chain of the switched system. 

Example 4.38 For the following three switching paths 

(i) DS pi = {O'o, h ), (i'i , hi), O2, 1*2), (h,h), ■■■} 
(ii) DS P2 = {(ii,h ), O'o, hi), (i 2 , h 2 ), (h,h-$), . . . } and 
(iii) DS P3 = {O'o, hi), (ii,h ), (i 2 , h 2 ), (h,hj,), ■■■} 

which two are closer? 

The transition chains of the paths are 

<p0'o,^o) I (p(ii,hi)(p(i ,h Q ) | <p(i 2 , h 2 )(p(ii, hi)<p(i , h ) | ••• , 
<p(il,h ) | (p(i ,hi)(p(ii,h ) | (p(i 2 , h 2 )<p(i , hi)cp(ii, h ) | ••• , 
<p(io,hi) | <p(ii,ho)(p(i ,hi) | cp(i 2 , h 2 )<p(ii, h Q )(p(i Q , hi) | ••• , 

respectively. 

Roughly speaking, though the switching time sequences totally coincide for the 
first and second switching paths, the index sequences are different for the first two 
periods, so the difference in time measure is ho + hi. Similarly, the difference 
between the first and third is 2\hi — ho\, and between the second and third it is 
2min{/io, hi}. In this sense, if hi > 2ho or ho > 2h\, then the distance between the 
second and third is shortest, otherwise the distance between the first and the third 
is shortest. In both cases, the distance between the first and the second paths is the 
longest. 
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Example 4.39 Consider two switching paths d\ and 02 in discrete time, which are 
represented by sequences 

01 =3124213111311222122 1, 

02 = 312431311331122122 1, (4.71) 

which are of lengths 20 and 19, respectively. To compare the sequences, two intu- 
itive ways are aligning the sequence by adding and by removing certain elements 
to/from the sequences. By adding new elements, we have 

01 = 312423131113311222122 1, 

02 = 312423131113311222122 1, (4.72) 

where the numbers with a bar are newly added. It is clear that five new elements 
are incorporated, and 0i is identical to §2 . Similarly, by removing elements from the 
sequences, we have 

\2 t 1 f2 
01=3124131131122122 1, 
02 = 3124131131122122 1, 

4,3 4,3 

where five elements are removed, and 6\ is identical to §2 . Note also that the cardi- 
nality of 0i is 22, the cardinality of 6\ is 17, and the difference is five. As a result, it 
is intuitively proper to define the absolute distance between 9\ and 82 to be five. 

The above examples motivate us to define the distance between two switching 
paths through the time variation while ignoring the dynamic difference between the 
system matrices, that is, we assume, for simplicity, that the distance between any A,- 
and A ,• is normalized. 

Let A be the set of intervals of the form [a, b) with < a < b and of unions 
of such intervals. Given n e A, we can define the map \jr n : (R + — tt) h-> R + 
by 

TJr n {t) — t — measf,? < t : s e tt], t e R+ — tt. 

Given two switching paths p\^ tl t2 ^ and p2[ t3 f4 ), pi is said to be a child-path 
of p2, or p2 is said to be a parent-path of p\, denoted by p\ < p2, if there exist 
tt e A and a time transition 8 eR such that 

[fi,b)= U {1M0-*}. 

te([t 3 ,t 4 )-jT) 
P2(t) = pi(f 7l (t)-S) Vte[t 3 ,t 4 )-iT. (4.73) 
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Correspondingly, let Ap x be the set of it that satisfies (4.73). It should be stressed 
that the set A p p \ may contain more than one element. 



pi 

Pi " 

For two switching paths pi ■< p2, define the distance to be 



\p 2 — pi\— inf measjr. (4.74) 

It is clear that \p2 — pi \ — iff pi is a pure time transition of pi, that is, £4 — 1 3 = 
ti — ti and pi (?i + s) = P2(t3 + s) for all s e [0, t% — t\). In this case, we denote 

P2 = Pi 

Given switching paths pi, p2, and pi,, pj is said to be a common parent-path 
of pi and p2, denoted pj, e CP(pi, P2), if pi < pj and p2 < pi- It can be seen 
that, for any two switching paths, there must exist a common parent-path. Indeed, 
suppose that 

DS Pj ={(ii,hi),(i{,h{),(i 2 i ,h{),...}, ; = 1,2. 

Then, the switching path 

DS P3 = {(i l ,hl), (/ 2 , h 2 ), (i{,h\), (il hi), {ilhl), {i\, hi), ...} 

is a common parent-path of pi and p2- 

Definition 4.40 For any switching paths pi and p2, the distance between them is 
defined as 

d(pi,P2)= inf (\P3-Pl\ + \P3-P2\). (4.75) 

P3£CP(p[,p2) 

Remark 4.41 It is interesting to note that the switching distance is closely related to 
sequence alignment, which is one of the basic tasks of bioinformatics. A primary us- 
age of alignment is to attempt to identify regions of sequences that share a common 
evolutionary origin. That is, the purpose of sequence alignment is to identify the 
similarity of two or more biological sequences. It is clear that the smaller distance, 
the more similarity. Taking mRNA sequences as an example, they are taking values 
from alphabet {A, C, G, T}. In fact, if we relabel A, C, G, and T with 1, 2, 3, and 4, 
respectively, then the sequences (4.71) are exactly segments of mRNA sequences as 
shown in [191, Fig. 2B]. While numerous computer algorithms were developed for 
sequence alignment, the distance defined here captures the major feature of many 
algorithms. The reader is referred to [181, 185] for recent development of sequence 
alignment. 

Proposition 4.42 The distance between switching paths possesses the following 
properties: 

(1) (positive definiteness) d(pi , p2) > 0, and d(pi , P2) — iff pi — p^ s for some 
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(2) (symmetricalness) d(p\, P2) = d(p2, P\) and 

(3) (triangular inequality) d(p\, p2) < d(p\ , pj,) + d(p2, pi) 

Proof Properties (1) and (2) straightforwardly follow from the definition. To 
prove (3), let s be an arbitrarily small positive real number. By definition, there 
is a common parent-path p4 of paths pi and pi such that 

d(p\,ps)> \P4~ Pl\ + \P4~ P3\ -£■ 
Similarly, there is a common parent-path p$ of paths p2 and pi such that 

d(p2, P?) > \P5 ~ Pl\ + \P5 ~ Pi\ ~ £ - 

On the other hand, we can find a common parent-path p(, of paths p^ and p$ such 
that 

\P6~P4\ < \P5~Pi\ and \P6~P5\ < \P4~Pi\- 
As p(, is also a common parent-path of p\ and p2, we have 

d(p\,p2) < \P6~ Pi \ + \P6~P2\ 

< \P6 ~ P4\ + \P4 ~ Pl\ + \P6 ~ P5\ + \P5~ P2\ 

< \P5 ~ P3\ + \P4 ~ Pl\ + \P4 ~ P3\ + \P5~P2\ 

< d(pi, p 3 ) + d(p 2 , Pi) + Is. 

Due to the arbitrariness of s, the triangular inequality holds. □ 

It follows from the proposition that the set of switching paths forms a metric 
space. 

Next, we formulate the distance between two switching signals generated by a 
pathwise state-feedback switching law. Fix a pathwise state-feedback switching law 
Aj=i 0. ' • F° r an Y given switched system, it generates a switching signal a x for any 
initial state x that is the concatenation of the switching paths #,-, i — I, ... ,k. This 
switching signal can be described in a recursive way, as described below. 

(1) Initiation. From the initial state xq, choose the active subsystem index j e 
{1, . . . , k} such that xq e Qj, and let the system evolve along switching path Bj 
for the duration of s j. At the end of the process, the state is x\ — (P(sj;0,xq,9j), 
which is termed as the current relay state at t\ — Sj. 

(2) Recursion. From the current relay state x v at t v , choose the active subsystem 
index / e {1 , . . . , k} such that x v e Qi , and let the system evolve along switching 
path 6i for the duration of si. At the end of the process, the state is x v +i = 
<j)(si\ 0, x v , 9i), which is the current relay state at t v +\ — t v + s/. 

Suppose that we are to implement the (nominal) switching signal in the above- 
mentioned recursive way. Then, perturbations may enter in the following possible 
manners: 
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(1) When implementing a switching path Q- t for a duration of s/, mismanipulations 
may occur in certain cases. For instance, a time delay in the operation or com- 
ponent (subsystem) failures lead to displacement of switching paths, etc. 

(2) At the concatenating instants t\ , the next piece of switching path is wrongly 
selected due to the imprecise measure of the current initial state. 

In either case, due to the interaction between the continuous state and the switch- 
ing signal, for the same initial state, any small perturbation may lead the perturbed 
switching signal to totally deviated from the nominal switching signal. This in- 
dicates that the distance between the perturbed switching signal and the nominal 
switching signal should be formulated based on the following rules: 

(1) The distance should be counted locally (piece by piece) rather than globally. 

(2) Any mismanipulation should be counted only once in the sense that the future 
effluence should not be taken into account to the distance. 

(3) Once a mismanipulation occurs, the next current relay state should be taken as 
the nominal initial state for future comparison between the switching signals. 

In the light of the rules, we rewrite the nominal switching signal a n as 

+oo 

J2 (Xi , ji , e h ,s h ): x i+ i=<p (sj. ; 0, x t , Q h ) e Q h+] . (4.76) 

!=0 

Suppose that the perturbed switching signal a p can be expressed in a similar way as 

/](yi . K; , pi ,ti): yi+i = 4>(ti ; 0, yt ,pi), y — x , (4.77) 

i=0 

where Kj is the actually selected (perturbed) index of the switching path for the 
current initial state y, , and p; [0 , is the actual (perturbed) implementation of dj K . . It 
can be seen that a deviation occurs when either y, ^ Q Ki or pi ^ 0j K . . 

Definition 4.43 For a path wise state-feedback switching law /\, =1 0- ' , let a* and 
a* be the nominal switching signal and perturbed switching signal with initial 
state x, respectively. 

(1) For a natural number N, the Af-distance between a* and a* is 

N-l 

D^{a p ,a n ) = Y J d{p i ,d k ), (4.78) 

;=o 

where/, is the index that y, e Q\ t fori =0, ... , 7Y— 1, and<i(-, ■) is the distance 
between two switching paths as defined in (4.75). 
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(2) The relative distance between the nominal switching signal a* and the per- 
turbed switching signal cr* is defined as 

RD x (° P ,°n) = Hmsup -D^(a p ,a n ). (4.79) 

(3) The supremal relative distance between the nominal switching signal a n and the 
perturbed switching signal a p is defined as 

SRD(o p , o n ) = \vsnswpRD x (0p, a n ). (4.80) 

xeR" 

Remark 4.44 The TV-distance measures the absolute distance between the nominal 
switching and the perturbed switching over the first TV-concatenating periods. It is 
the summation of the distances between the nominal and perturbed switching sig- 
nals. The relative distance, on the other hand, measures the average distance in time 
over an infinite horizon. It should be stressed that the relative distance is more subtle 
than the (absolute) TV-distance in characterizing the distance between two switching 
signals. In fact, for any two switching signals defined on an infinite horizon, the ab- 
solute oo-distance must be infinite if the relative distance is positive, but the reverse 
is not necessarily true. 



4.5.2 Robustness Analysis 

In this subsection, we establish that a well-designed pathwise state-feedback switch- 
ing law is robust against various types of perturbations including structural pertur- 
bations, unstructural perturbations, and switching perturbations. 

Suppose that the pathwise state-feedback switching law a — /\,-_j d- ' is piece- 
wise contractive for the switched linear system 

x + (t)=A a(f) x(f), (4.81) 

where A\ , . . . , A m are known real matrices. Define 

Pi= sup \<t>{si\ Q,x,6i)\ < 1, i = l,...,k. (4.82) 

According to the analysis in Sect. 4.4.1, we have 

k 



<M?;O,x,/\0/M 



</3e-°"\x\ VieR", t e %, 



where a and /3 are positive real numbers that can be explicitly estimated. 

The first property of the switching law is its robustness with respect to structural 
perturbations. 



178 4 Designed Switching 

Theorem 4.45 There is a positive real number s such that the switching law expo- 
nentially stabilizes any switched linear system 

x + (f) = A a{t) x(t) (4.83) 

with max"^j || A, — A; || < e. 

Proof The main idea is to prove that the switching law is still piecewise contrac- 
tive w.r.t. the perturbed system when e is sufficiently small. To see this, we ex- 
amine the state transition matrices of the nominal and perturbed systems, respec- 
tively. For switching path 0,-, denote by to, t\, . . . , tk its switching time sequence. 
Let <P(sj, 0, Of) and <£(.?,, 0, 0,-) be the state transition matrices of the nominal sys- 
tem and the perturbed system, respectively. It is obvious that 

<P(si, 0,0i) = e Aa{ 'k )(Si ~ tk) ■ ■ ■ e Aa{ 'o^ h ~ to \ 
0(s h O, Of = e A, "-'0 (Si ~' k) ■ ■ ■ e Aa{ 'o^ h ~' o) 

in continuous time and 

<P(si, 0, 0i) = A a(Si -i) ■ ■ ■ A CT (o), <P(si, 0, 0i) = A a(Si -i) ■ ■ ■ i CT(0 ) 

in discrete time. Define the error 

<p = 0( Si , 0,0i) -0(si,O,Oj). 

It is clear that is a continuous function of the entries of matrices A, for i = 
1, . . . , m. Note that — when A; = A; for i = 1, . . . , m. It follows from (4.82) 
that 

sup \0(sj,O,0i)x\ < 1, i — l,...,m, 

*sJ2,nHi 

when max?Lj || A,- — A,- 1| is sufficiently small. This clearly leads to the conclusion. □ 

Remark 4.46 The robustness against structural perturbations is sometimes termed as 
structural stability. The property is important in that the system cannot work prop- 
erly if it is not structurally stable. An interesting open problem is how to estimate 
the margin e explicitly. 

Next, we turn to the robustness w.r.t. unstructural perturbations. We formulate 
the problem by means of the framework of input-to-state stability (ISS). 
For the perturbed system 

x + (t) = A a( t)x(t) + w(t), (4.84) 

where w(t) e R" is the unstructural system perturbation, we take the perturbation 
as an uncontrolled input. 
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Definition 4.47 For a switching law a, system (4.84) is said to be input-to-state 
stable (ISS) w.r.t. the switching law, if there exist real-valued functions a e ICoo and 
P e ICC such that 

\(j){t; jco, a, w)\ <max{ / S(x ,0,a(|w f |oo)}, Vx , w,t e%, (4.85) 

where |u/|oo = su P.re[r r) I^WN anc ' 0(*! x o, &, w) denotes the solution of (4.84) 
with initial condition x(0) = x$. 

This notion degenerates into the standard ISS for nonswitched systems [21 1]. 
The second property of the switching law is that it steers the switched system 
ISS. 

Theorem 4.48 The switched system is input-to-state stable under the switching law 

Proof For the perturbed system (4.84), its aggregated system is 

zi+i = Gtzi + vi, zieQj, (4.86) 

where 

fSi 

vi — 0(si,r,Oi)w(ti + r)dr, leN 
./o 

in continuous time, and 

Si-l 

vi = ^0{si,j,d{)w{ti+j), leN 

7=0 

in discrete time, and 0, ti, ?2> • ■ ■ is the switching time sequence. This implies that, 
for any nonnegative integer /, we have 

J = max {| vol, |vi|, ..., |v z |} < usup{\w(t)\ : t e [t ,ti]}, (4.87) 

where 

u = max(e l|A ' ll ' s ,...,e l|A <" ll ' s ) 
in continuous time, and 

u = max(||Aif ,..., \\A m \\ s ) 

in discrete time. Here s — max{s\, ... ,Sk}. 

In view of (4.82), let /x = maxfpi, . . . , pu\, and let /2 be a real number in (//,, 1). 
Fix a natural number j. For any I < j, if \zi\ < -J^—, then we have 

\z M \ = \G i zi + vi\<fji\zi\+(o } <- . 

H — H 
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This means that the closed ball B j is invariant in that the successor of any state 
within the ball is still kept in the ball. On the other hand, if \zi \ > ^zrr, then we have 

km I <iAzi\ + ^ j < Ak/I- 

The above facts clearly lead to 

|z ; |<max(/l'|*o|,^M V/=l,...,j. (4.88) 

H - fj. J 

It is also clear that 

\<t>(t;x ,(T,w)\<v\zi\ Vf &(ti,ti+i), 1 = 0,1,2,.... (4.89) 

Combining (4.87), (4.88), and (4.89) yields 



\4>{t; xo, o, w)\ < 



„, u 2 w r , 
vfle' ", } VteTo, 



where a = m ( "^ - s ■ This clearly exhibits that the original system is input-to-state 
stable under the switching law. □ 

The next property is the robustness of the switching law against switching per- 
turbations. In terms of the distance between switching signals defined in Defini- 
tion 4.43, we have the following result. 

Theorem 4.49 There is a positive real number y such that the switching law 
/\ i= l0 i ' exponentially stabilizes any switched linear system 



x + {t) = A- a{t) x(t) (4.90) 



withSRD(a,/\- =l 6^)<y. 



To proceed with the proof of the theorem, we need the following technical 
lemma. 

Lemma 4.50 Suppose that pi and p2 are switching paths defined over in- 
tervals [0, ti) and [0, T2), respectively, and x is an arbitrarily given state. If 
\4>(ti; 0, x, p\)\ < is\x\ and d(p\, pi) = £ , then, we have 

|0(r 2 ; 0,x, p 2 )\ < {n T,+l;+l t + f)\x\, (4.91) 

where n = max|'L 1 e" " in continuous time, and r\ = max(l, max^ ||A,-||) in dis- 
crete time. 



4.5 Stabilization via Mixed-Driven Switching: Robustness Analysis 181 

Proof Here we only prove for the continuous time, and the discrete-time case can 
be proceeded in a similar manner. Let e be an arbitrarily given positive real number. 
By the definition of the distance between two switching paths, there is a common 
parent path p over [0, x) of p\ and p2 such that 

\p-pi\-\-\p-pz\ <C + £• 
Denote £i = \p — p\\ and £2 = \p — Pi\- Suppose, for instance, that 

*(Ti, 0, pi) = e A2h2 e A > h > , *(t, 0, j>) = e A ^ e A 4A4 e A 1 ft le A 3 A 3 _ 

Other cases can be treated in exactly the same way. Simple computation yields 

\<j)(r;0,x,p)\ < \<Kt;0,x, p) - 4>(ri',0,x, p\)\ + \<f>(ti;0,x,pi)\ 

< \e A2h2 e A4h *e Aihi e A3hi x-e A2h2 e A < hl x\+f\x\ 

< \e A2h2 (e A ^ - l)e A ^e A ^x\ 

+ \e A2h2 e A ' hi (e A3h3 - I)x\+f\x\ 

where the relationships x\=h\ + 112, ?i = I13 + h.4 and \\e At — I\\ < || A||e" A " ? |f | 
have been used. Further calculation leads to 

|0(t 2 ; 0, x, p 2 )\ < \4>{t2\ 0, x, pi) -</>(r; 0, x,p)\ + \<p(x; 0,x,p)\ 

<n T2+ ^ 2+ ^ 2 \x\ + \(p(r;0,x,p)\ 

<(r) tl+l;+s+ \$+e) + ir)\x\, 

where the relationship xi < x\ + f 1 was utilized. This completes the proof due to 
the arbitrariness of e. □ 

Proof of Theorem 4.49 Let xq be any given but fixed state, e be any given pos- 
itive real number, and a x ° and ct a ° be the nominal switching signal and the per- 
turbed switching signal generated by the switching law /\, =1 B- ' w.r.t. initial state 
x(0) = xq for the nominal system and the perturbed system, respectively. Recall that 
SRD(a, /yJLj 6?') < y means that RD XQ (a x °, a x °) < y, which further means that 
the N -distance between the perturbed switching and the nominal switching is upper 
bounded by N(y + e) for sufficiently large N. 
Rewrite the nominal switching law as in (4.76): 

+00 
°" v ° = X! C** - Ji > 9 h ' s h ) : *m = 4> (sj, ;0,xi, Oj, ) e i2 jw . 

i=0 



182 4 Designed Switching 

Similarly, rewrite the perturbed switching law as in (4.77): 

+oo 

o x ° = } jyi,Ki, pi, Tj) : y i+ \ = <p(xj\ 0, yi, pi), yo = x . 

i=0 

We are to prove that the state sequence yo, y\ , , , . is exponentially convergent, which 
implies the exponential stability of the perturbed system. For this, we only examine 
the continuous time, and the discrete-time case can be proven in a similar manner. 
In view of (4.82), let /x = max{pi , . . . , pk], and let /x be a real number in (it, 1). 

def 

Fix an arbitrarily given natural number i. Let r = maxf^i, . . . , s^}, and let ■& — 
^-( T + 2 )(/i — fx). It follows from Lemma 4.50 that 

|y»l</*ly,-ll iid(p i ,9 ji )<&. (4.92) 

Applying Lemma 4.50 again gives 



ly, 



< 



Lr+di+i + ^\ di \yi-i\ < rf+tdtlyi-il Hdiyt^j,) > V, (4.93) 



def 



where X — r + 2 + max{0, (ln/Lt — \n&)/\nrj], and di — d(yi, $j,). Now choose 
Y — e — m & where m is a positive real number to be determined later. Let / be a 
(sufficiently large) natural number such that, for any N >l, the TV-distance between 
the perturbed switching and the nominal switching is upper bounded by N(y + e). 
Fix N >l and define 

Ni=#{i<N: |y ; |>/x|v,-i|}, N 2 = N-Ni, 
where # denotes the cardinality of a set. By the definition of TV-distance, we have 

Ni < \Nm~\ , 7V 2 > [N(l - zu)\ , 

where \a~\ {[a\) denotes the smallest (largest) integer equal to or greater (less) 
than a. Based on the above facts, routine calculation gives 



\y N \ < lyol^ 2 ]1 r, X+ M<e- v ^-^-% 2 |.vo| 



-v(N(l-m)-\) 2Nm(\+e k - l )\ 
'I "-i —<- 

< e -(N-l)v e N(v+2+2e^)ur lxol (494) 

where v = — ln/i, and the fact that max A (-) A = e* was used. 

Finally, let m — v x-1 , which is clearly independent of N. Then, it can be 

seen from inequality (4.94) that the sequence yo, yi, . . . is exponentially convergent 
with rate v/2, This completes the proof. □ 

Remark 4.51 Theorem 4.49 reveals that the pathwise state-feedback switching law 
is robust against perturbations from the switching law itself, which means that the 
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switching law is fault tolerant — a very important property from the practical point of 
view. Moreover, it can be seen from the proof that the allowable robustness margin 
y can be explicitly estimated. 

Finally, by combining Theorems 4.45, 4.48, and 4.49, we can prove the follow- 
ing comprehensive robustness property of the switched system with the stabilizing 
pathwise state-feedback switching law. 



Theorem 4.52 Suppose that the switching law /\;=i ^; ' exponentially stabilizes 
the nominal system 

x + {i) = A a(f) x(f). 

Then, there are positive real numbers €\ and €2 such that the switching law makes 
the perturbed system 



x + (t) = A a{t) x(t) + w(t) 



input-to-state stable if 



max II At — At II < 61, 

*=1 



SRD\d,/\6^\<€ 2 . 



(4.95) 



4.5.3 Examples and Simulations 



Example 4.53 Let us examine the discrete-time switched linear system 



x (t + 1) = A a(t) x(t), x(t) e R z , a(t) e {1,2, 3} 



(4.96) 



with 



and 



-0.7113 0.5333 
1.8498 0.0968 



A 2 : 



-0.0378 0.4588 
2.4130 0.4437 



A 3 = 
Simple computation exhibits that 



-0.7714 0.2266 
-0.8239 -1.4026 



X l (A i )X 2 (A i )> 1, i = 1,2,3, 

where {A 1 (A), X 2 (A)} is the spectrum of matrix A e R 2x2 . It follows from 
Lemma 4.3 that the switched linear system is not consistently stabilizable. That 
is, the system cannot be made stable via any single switching signal. 
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To verify the stabilizability of the switched system, we conduct the computational 
algorithm in Sect. 4.4.2, which yields 

\Jy Gi =B\ = [-i,n 

where 

Gi=Aa, G 2 = A 2 , G3 = A 3 , G 4 = A 2 l A 3 , G 5 = A 2 A l A 3 , 

and the corresponding switching paths are 

9i = (1), 62 = (2), 63 = (3), 04 = 0,1,1), 05 = 0,1,2). 

As a result, the algorithm terminates with k — 5, which exhibits that the switched 
system is exponentially stabilizable. To further calculate a stabilizing pathwise state- 
feedback switching law, we choose 

A x = [-0.0995, 0.4540) c y Gl , 

A 2 = [-0.3895, -0.0995) c y Gl , 

A 3 = [-0.7100, -0.3895) C y Gi , 

A 4 = [-1.0000, -0.9625) U [0.4540, 1.0000] c y Gi , 

A 5 = [-0.9625, -0.7100) C y Gs , 

which generate the state space partitions 

£2 X = {rV 2 ~ l y: r e R, yeA { ), 

£2i = {rV 2 ~ l y: r^0, ye A t }, i = 2,...,k. 

Figure 4.11 shows the y G . 's, the A t 's, and Qj's. 
With the state partitions, the aggregated system is 

Zj + i = GtZj, ZjeQi 

with zo = x(0). It is clear that the aggregated system is exponentially stable, and 
the pathwise state-feedback switching law /\ !=1 0j ' exponentially stabilizes the 
original switched system. 
Take the initial state to be 

x(0) = [1.1908, -1.2025] 7 ". 

In what follows, we present simulations for the nominal systems and its perturbed 
systems, respectively. 

Firstly, Fig. 4.12 shows sample state phase portraits for the original system and 
the aggregated system. It can be seen that the aggregated state trajectory is always 
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Fig. 4.11 State partitions (right) and their projections (left) 




contractive relative to the norm | ■ 1 1 , while the original state trajectory is not neces- 
sarily contractive at the nonaggregated instants. 

Secondly, to illustrate the robustness against structural perturbations, we assume 
that the matrices A, are perturbed by the matrices A,-, where 



A,= 



0.2117 
0.1243 



-0.3501 
0.1395 



A 2 = 



0.1623 
0.1273 



0.2620 
0.0654 



and 



A 3 = 



-0.1346 
-0.0299 



-0.4898 
0.0947 



Figure 4.13 depicts the state phase portrait for the perturbed system 

x(t + I) = (A aU) + A a(t) )x(t). 

It is clear that the perturbed system is also exponentially convergent, though the 
convergence rate is lower than that of the nominal system. 

Thirdly, to illustrate the robustness of the switching law with respect to switch- 
ing perturbations, we assume that the nominal switching signal is perturbed in the 
following way: (i) a delay occurs at each time implementing the switching path 
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Fig. 4.12 State phase portraits of the original system and the aggregated system 
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Fig. 4.13 State phase portraits of the structurally perturbed system 
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• original state 
° aggregated state 



-1 



Fig. 4.14 State phase portraits with perturbed switching 



6*i = (1), that is, the perturbed switching path is B\ = (1, 1); and (ii) the state mea- 
surement is inexact in that the measured state is x — [l.ljti.JCi] for any state 
x — [x[ , X2] T , that is, there is a ten-percent overdue for the first state variable. Fig- 
ure 4.14 shows the state phase portrait for the perturbed system. It is clear that the 
state is still convergent. A routine calculation gives that the relative distance in the 
simulated horizon is 0.0526. This means that over five percent length of the switch- 
ing signal is wrongly implemented. 

Fourthly, to illustrate the input-to-state stability, let us examine the perturbed 
system 

x(t+ 1) = A a (f)x(f) + w(t) 

with w(t) — sgn(tan(f)), and sgn(-) denotes the signum function. The state phase 
portrait for the perturbed system is shown in Fig. 4. 15. It can be seen that the system 
is input-to-state stable with a reasonable bound. 

Finally, by putting all the above perturbations together, we have the perturbed 
system with three types of perturbations. Figure 4.16 depicts its state phase portrait, 
which is still input-to-state stable with a bigger overshoot. 

Example 4.54 For the continuous-time switched linear system 



x(t) = A a ( t )x(t), x(t) e R j , ait) e {1,2}, 



(4.97) 
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Fig. 4.15 State phase portrait illustrating the ISS property 




original state 
D aggregated state 



Fig. 4.16 State phase portrait of the mixed perturbed system 
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Ai = 


-0.4203 
-1.4281 
-0.2091 


1.4913 0.3085 
1.2367 -1.1178 
0.7129 -0.7467 


A 2 = 


" 0.1967 
0.5359 
-1.0481 


-0.5520 0.9880 

-0.7562 -1.0518 

0.7114 0.8080 


simple computation exhibits that 

3 





^V(A;)>0, f = 1,2. 
7 = 1 

By Lemma 4.3, the switched linear system is not consistently stabilizable. In partic- 
ular, the matrices A i and A 2 do not admit any stable convex combination, and the 
system is not quadratically stabilizable [80]. 

Let the sampling period be t =0.38, and B{ —e A ' T fori — 1, 2. For the sampled- 
data switched system 

x((j + l)r) = B a(jr) x(jr), j e N, 

we apply the computational algorithm in Sect. 4.4.2. This gives 



\Jy« 



B 



where 



BlBt, 



B 2 Bi 



G3 = B{B 2 Bu Ga = B\B\B x , 



G 5 = B|Bi, G(, = B]B 2 B X , 



G 1 ^B\B 1 B l B 1 , 



G s = BiB 2 BfB 2 , G 9 = B%B l B 2 Bi, 



G w = BJBl 



As a result, the algorithm terminates with k — 10, which exhibits that the switched 
system is exponentially stabilizable. The corresponding switching paths can be for- 
mulated routinely as, for example, 



0i(O 



Oiit) 



2 te[0,2r), 

jl te[2r,3r), 

il te[0,2r), 

12 te[2r,3r), 



and so forth. To determine the state partitions, let 

A 1 = y Gu 
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./-I 



A j=yGj-\J A '' j= 2 > 



1=1 

which generate the state space partitions 

Q { = [rV^y: r e R, ye A^, 

Q t = {rV^y: r ^ 0, ye A/}, i = 2,...,k. 

Hence, the aggregated system is 

Zj+i = G(Zj, ZjeQj, 

with z = x(0). 

From the above preparation, we are ready to implement the pathwise state- 
feedback switching law /\y_j 0. ' . Take the initial state to be 

x(0) = [-0.6918, 0.8580, 1.2540] r . 

Figure 4.17 shows the original state and the aggregated state of the closed-loop 
system. It can be seen that the systems converge exponentially with satisfactory 
rate. 



S?-0.5 




Fig. 4.17 Original (upper) and aggregated (lower) state trajectories 
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The next steps are to verify the robustness of the switching law w.r.t. various 
types of perturbations. For this, we take the perturbed matrices to be 



A. = 



A 2 



0.3915 -0.0680 0.2380 
0.1009 -0.2280 -0.2232 
0.3729 -0.0422 0.1271 

"-0.1203 0.0172 0.0924 " 
0.1102 -0.4009 -0.0642 
-0.2200 -0.0986 0.2473 



and the unstructural perturbation to be 

w(t) = cos(sin(r)), t e %. 

As for the switching signal, we assume that the nominal switching signal is per- 
turbed in the following way: (i) a delay of d — 0. 1 sec occurs at each duration of the 
second subsystem in a sample period. That is, the sampling period for the second 
subsystem is x + d instead of r ; and (ii) the state measurement is inexact in that the 
measured state is x = [x\ , xi, 0.9x3 ] T for any state x — [jq , X2, X3] , that is, there is 
a ten-percent error in measuring the third state variable. Let a denote the perturbed 
switching signal for the initial state xo. Figures 4.18, 4.20, and 4.19 show the state 
motions for the perturbed systems 

x(t) = (A e r(f) + A a ( f ))x(t), 




Fig. 4.18 State trajectory of the structurally perturbed system 
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Fig. 4.19 ISS stability of the unstructurally perturbed system 
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Fig. 4.20 State trajectory with perturbed switching signal 



4.6 Notes and References 

30 



193 



8 5 




Fig. 4.21 State trajectory of the mixed-perturbed system 



and 



x(t) = A a(t) x(t) + w(t), 



x(t) = Aa(i)X{t), 



respectively. It is clear that the state trajectories are still convergent and bounded, 
respectively. 

Finally, by putting all the above perturbations together, we have the perturbed 
system with three types of perturbations given by 

kit) = (A 5(t) + A 5(t) )x(t) + w{t). 

Figure 4.21 depicts the state trajectories, which is still input-to-state stable with a 
bigger overshoot. 



4.6 Notes and References 



When the switching signal is a design variable for the switched system, the primary 
issues for stability and robustness include (1) establishing stabilizability criteria, or 
equivalently, identifying the class of switched systems which could be made sta- 
ble by means of suitable switching laws; and (2) stabilizing switching design, or 
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equivalently, developing computational algorithms for finding switching laws that 
achieve stability and robustness. For both issues, many works have been published 
in the literature. The stabilizing switching design problem received a lot of attention 
in the literature. In particular, it was found that, when there is a stable linear convex 
combination of the subsystems, the switched systems are quadratically stabilizable 
[15, 258, 259]. It was also proved that the converse is also true for switched linear 
systems with two subsystems [80]. For the class of switched linear systems that ad- 
mit stable convex combinations, quite a few stabilizing switching design procedures 
have been reported, among which the most notable are the periodic switching design 
based on the average approach [250, 257, 258, 267, 277], the state-feedback switch- 
ing design based on the Lyapunov method [87, 217, 259], the passivity/dissipativity 
approach [281, 282], and the combined switching design to reduce the switching fre- 
quency [219, 263, 264]. However, it is well recognized that the existence of a stable 
convex combination is too conservative for quadratic stabilizability, not to mention 
the general stabilizability which is not necessarily quadratic or even convex [35, 36]. 
For the robust switching design problem, which is to find switching laws that steer 
the switched systems stable and robust in the presence of perturbations and dis- 
turbances, there were also some delightful developments. In particular, it has been 
revealed that the class of consistently stabilizable switched linear systems is also 
robust against small structural perturbations [213, 216], Lyapunov-like techniques 
were also utilized to tackle the problem [276], and a comprehensive treatment can 
be found in [150, 151]. 

This chapter presented the state-of-the-art development on stabilizing switching 
design. We examined the problems of stabilization by means of time-driven switch- 
ing, state-feedback switching, and mixed-driven switching, respectively. In particu- 
lar, we show that asymptotic stabilizability is equivalent to the existence of a smooth 
switched Lyapunov function, and furthermore, the set of min functions is proven to 
be universal in providing switched Lyapunov functions for switched linear systems. 
By proposing the pathwise state-feedback switching law, the stabilizing switching 
design problem and the robust switching design problem were addressed in a uni- 
fied and rigorous framework for both continuous-time and discrete-time switched 
systems. 

Section 4.2 presented several properties of consistent stabilizability, which is sta- 
ble under a time-driven switching signal. The material was mostly taken from [216]. 
While the periodic switching is not able to generally address the problem of sta- 
bilization, recent progress indicates that eventually periodic switching signals are 
capable of fully characterizing the problem [16]. 

In Sect. 4.3, the switched Lyapunov function in Definition 4.8 is an autonomous 
function of the state, and the word "switched" here reflects the fact that it needs only 
to decrease along the most descendent switching signal. In the literature, the con- 
cept of switched Lyapunov functions appeared in [60], which is switching-signal- 
dependent and is with a different meaning. The converse Lyapunov theorem for 
switched nonlinear system, Theorem 4.10, could be seen as a special case of the 
converse Lyapunov theorems established in [58, 198] and [129] for more general 
class of dynamical systems. The converse Lyapunov theorem for switched linear 
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systems, Theorem 4.12, could be found in [222]. The two counterexamples, Exam- 
ples 4.15 and 4.17, are owned to Blanchini and Savorgnan [35, 36]. The composite 
quadratic Lyapunov functions have been investigated in [114, 115]. Theorem 4.19 
and the supporting material were adopted from [279, 280] for discrete-time systems 
and from [192] for continuous-time systems. 

The main content of Sects. 4.4 and 4.5 was adopted from [225]. Example 4.27 
was taken from [217]. Corollary 4.31 can be found in [218]. Section 4.5.1 and The- 
orem 4.49 were adopted from [231, 235]. 



Chapter 5 

Connections and Implications 



A notable and attractive feature of a switched dynamical system is its wide con- 
nections with many other known types of dynamical systems. As a result, stability 
of switched systems has clear implications in stability and robustness analysis for 
many well-known system frameworks. In particular, the guaranteed stability under 
arbitrary switching can be seen as robustness against the switching signal, which 
is an aggregation of the robustness for a nominal plant with structural/unstructural 
linear/nonlinear time-invariant/time-variant uncertainties or disturbances. The au- 
tonomous stability of piecewise linear systems is closely related to stability analy- 
sis of highly nonlinear systems by means of piecewise linear approximation. The 
stabilizing switching design methodology provides hybrid control approaches for 
controlling and optimizing highly nonlinear systems with possibly unknown param- 
eters. 

In this chapter, we investigate several typical problems in systems and control 
that are closely related with stability of switched linear systems. The problems in- 
clude the absolute stability of Lur'e systems, stability of T-S fuzzy systems, con- 
sensus of multiagent systems, supervisory adaptive control, and stabilization of con- 
trollable systems. By establishing their connections with switching-oriented analy- 
sis and design, the ideas and methods developed in the previous chapters can be 
applied to the problems either directly or indirectly. 



5.1 Absolute Stability for Planar Lur'e Systems 

Lur'e systems are closed-loop systems consisting of linear plants and sector- 
bounded uncertain output feedbacks. Absolute stability is a problem that looks for 
the largest possible sector bounds within which the Lur'e system is globally asymp- 
totically stable with respect to all the sector-bounded uncertainties. As a classic 
topic of interest, the problem provides a most originating and stimulating source 
of motivation for the development of the nonlinear control theory. In Sect. 2.5, we 
discussed the connection between the absolute stability of a Lur'e system and the 
guaranteed stability of a switched linear system. In this section, by taking advantage 
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of the connection, we present an algebraic criterion for the guaranteed stability of 
planar switched systems and apply the criterion to the problem of absolute stability. 



5.7.7 Guaranteed Stability in the Plane 



Consider the planar continuous-time two-form switched linear system given by 

x — A a x, (5.1) 

where xeR 2 , a e {1, 2}, and A\ and A 2 are stable matrices in R 2x2 . 

For a matrix A e R 2x2 , let detA and tr(A) be the determinant and the trace, 
respectively. Furthermore, introduce the notation 

disc(A) = tr(A) 2 -4detA, 

1 



r(A 1 ,A 2 ) = -(tr(A 1 )tr(A2)-tr(AiA 2 )), 



if disc(A,)^0, 

if disc(A,) = & disc(A ; ) ^ 0, 



i/f = 



tr(A,) 
V|disc(A,-)| 

tr(A,Q 
^/\disc(Aj) 

^ if disc(A!) = disc(A 2 ) = 0, 

w , 2 !^» ^ ( tr(Ai A2) - i tr(Ai) tr(A 2 ) 

tr(Ai)tr(A 2 ) V 2 



A = 4(r(Ai, A 2 ) 2 - r(A u Ai)r(A 2 , A 2 )), 



arctan 



arctanh 



tr(Ai)tr(A 2 )(i/fT,-+Tj) 
2tit 2 VA 



M(Ax)lr(A 2 )(fz i -T j ) 
2-fA 



I (tr(AiA 2 )-tr(Ai)tr(A2)/2)T I 
2r(Ai,A 2 )+VA 



if disc(A,) < 0, 
if disc(Aj) > 0, 
if disc(A ; ) = 0, 



2VdetA!detA 2 



nm+nm 



where i — 1,2 and j e {1,2} — {/}. Note that all the above constants are invariant 
w.r.t. coordinate transformations. In particular, disc(A) is the discriminant of ma- 
trix A, which is defined as the discriminant of its characteristic polynomial. For 
matrix A e R 2x2 , disc(A) > (disc(A) < 0) means that the matrix admits real 
(complex) eigenvalues. Observe that r, < 0, i = 1, 2, due to the fact that both A, 
are Hurwitz. As a result, we have sgnF(Ai, A 2 ) = sgn(riT 2 — ifr). Finally, observe 
that r(A, A) = detA and sgni/r = sgn(2tr(AiA 2 ) - tr(Ai) tr(A 2 )). 

Theorem 5.1 For planar switched linear system (5.1), we have the following state- 
ments: 



5.1 Absolute Stability for Planar Lur'e Systems 



199 



(1) If T{A\, A 2 ) < — Vdet A\ det A 2 , then the system is unstable. 

(2) If F(A\, A2) — — Vdet Ai det A 2 , then the system is marginally stable. 

(3) If T(A[, A 2 ) > -VdetAidetA 2 and tr(AiA 2 ) > -2VdetAi detA 2 , then the 
system is quadratically stable. 

(4) Otherwise, the system is stable, marginally stable, and unstable if zu < 1, 
uj — 1 , and m > 1 , respectively. 

To prove the theorem, we need some preparations. 

Lemma 5.2 If switched linear system (5.1) is (marginally) stable, then, for any 
positive real numbers k\ and /c 2 , the reseated switched system 



X — /\(jX , 

is also (marginally) stable. 



A[ — KjAj, i = 1,2, 



Proof As the system is (marginally) stable, it admits a common (weak) Lyapunov 
function that decreases along any subsystems. It can be seen that the function is also 
a common (weak) Lyapunov function for the rescaled switched system. As a result, 
the rescaled system is (marginally) stable. □ 

Based on the lemma, a normal form for the switched system can be described as 
follows. 

Lemma 5.3 Suppose that the commutator [A\, A 2 ] is nonsingular. Then, up to a 
linear coordinate transformation, exchanging of A\ and A 2 , and a rescaling ac- 
cording to Lemma 5.2, A\ admits the normal form 



n 1 

sgn(disc(Ai)) t\ 



(5.2) 



and 

(1) when det[Aj, A 2 ] < 0, there exists a real number F with \F\ > 1 such that 

F + sg"(disc(Ai)disc(A 2) ) = ^ md 



A 2 = 



t 2 sgn(disc(A 2 ))/F 

F T 2 



(5.3) 



(2) when det[Ai, A 2 ] > 0, we have ifr e (— 1, 1), and 



A 2 = 



T 2 + jl-f 2 



T2 



if 



(5.4) 



Proof We proceed with the case where det[Ai , A 2 ] < 0, and the other case can be 
proven in a similar manner. 
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Suppose first that both disc(Ai) and disc(A2) are negative. Let a, ± -J— I Pi 
be the eigenvalues of A, for i — 1,2, where a, < and /3, > 0, i = 1,2, By a 
coordinate change, we can put A\ and A2 into normal forms as 



Ar = 



a\ 



h u\ 



A 2 = 



a 2 
P2F 



-folF 

«2 



where F is a real number. This corresponds to putting A 1 into the normal form and 
then rotating the coordinates so that the integral curves of A2 are elliptical spirals 
with axes along the x\ and x 2 directions. Simple calculation gives 



\.AuA 2 -\ = fah.(F-\/F) 







It is clear that det[Ai , A2] < implies that F — l/F > 0. On the other hand, simple 
computation yields F + l/F — 2\[r. It is clear that we can choose F with \F\ > 1. 
Rescaling A,- by -J-, i = 1, 2, we obtain the normal forms as in (5.2) and (5.3). 

Next, suppose that disc(Ai)disc(A2) = 0. Up to exchanging A\ and A.%, we as- 
sume that disc(Ai) = 0. By a suitable coordinate change, we have 



Oil 1 

ay 



A 2 - 



a b 
c d 



It is clear that det[Ai, A2] = • 

[1 a ~d -1 
2c we have 
1 J 



T~ l A\T 



-c , which implies that c ^ 0. Taking the linear trans- 



r _I A 2 r 



a+d 
2 



disc(A2) 
Tc 

a+d 
2 



a+d 



If disc(A2) = 0, then 2i{r — c and ^^- — r 2 , and hence the transformed matrices are 
exactly of the normal forms. Otherwise, by further implementing the linear trans- 
formation 



T = 



V2 
disc(A 2 )|'/ 4 







disc(AT)|'/ 4 



and properly re-scaling, we can also obtain the normal forms. 

Finally, suppose that max{disc(Ai), disc(A2)} > and disc(Ai)disc(A2) ^ 0. 
Up to exchanging A\ and A 2 , we assume that disc(Ai) > 0. By a suitable coordinate 
change, we have 



a\ 






a 2 



A 2 : 



where a\ < a 2 . Simple computation gives det[Ai, A2] = bc(a\ 
plies that be < 0. By implementing the linear transformation 



a 2 ) , which im- 



-^=bfc 
1 



^bfc 

1 
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we have 




2 , 

T- l A { T- 

Vdisc(Ai) 


"n r 




and 




2 , 
V|disc(A 2 )| 


"t 2 sgn(disc(A 2 ))/F~ 
F r 2 
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where F satisfies F + sgn(disc( A 2 ))/F = 2\j/.Note that this is exactly of the normal 
form. The proof is completed. □ 

Remark 5.4 The lemma presents normal forms for the case that [Ai , A 2 ] is nonsin- 
gular. When the commutator [Ai , A 2 ] is singular, it is not hard to see that A\ and A 2 
are simultaneously triangularizable. As a result, the switched system is quadratically 
stable when both Aj and A 2 are stable (cf. Sect. 2.3.5). 

Lemma 5.5 Switched linear system (5.1) is quadratically stable iff for any co e 
[0, 1], we have 

det(ft)A x + (1 - co)A 2 ) > 0, det^Ai + Cl-oOA^ 1 ) > 0. (5.5) 

Proof Suppose first that the switched linear system is quadratically stable, that is, 
there is P > such that Af P + PA t < for i = 1, 2. It follows that A ( -7 > + 
PA7 1 < [154]. As a result, we have 

(wAi + (1 - co)A 2 ) T P + P(coAi + (1 - cw)A 2 ) < 0, 
(coAi + (1 - w)A" L ) r F + F(wAi + (1 - (w)A- 1 ) < 

for any co e [0, 1], which implies (5.5). 

When the switched system is not quadratically stable, then either A i A 2 or A i A^ 
admits (at least) one negative real eigenvalue [206] . We proceed with the case where 
A\ A^ admits a negative real eigenvalue, and the other case can be addressed in a 
similar way. It can be seen that there is a positive real number jjl such that 

det(/x/ 2 + A[A~ [ ) =0, 

which implies that 

det(/M 2 + Ai) = 0. 
This violates the first inequality of (5.5). □ 

Proof of Theorem 5.1 First, assume that F(Ai, A 2 ) < — VdetAi detA 2 . Taking 
(p(co) — det(&>Ai + (1 — &>)A 2 ) as a function of a; in [0, 1], we have 

<p(co) — co 2 det A i +2«(1 - &>)F(Ai, A 2 ) + (1 -&>) 2 detA 2 . 
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Straightforward calculation demonstrates that the minimum of the function is 
achieved at 

detA 2 -r(Ai,A 2 ) 

0)n = e (0, 1) 

detAi+detA 2 -2r(Ai,A 2 ) 



with 



-A 
^ 4(detAi+detA 2 -r(Ai,A 2 )) - 



In particular, when F(Ai, A 2 ) < —VdetAi detA 2 , we have <p(a>o) < 0, which im- 
plies that the matrix ooqA\ + (1 — &>o)A 2 admits a positive real eigenvalue, and the 
switched system admits an unstable convex combination. As a result, the switched 
system is unstable. On the other hand, when A = 0, we have <p(a>o) — 0. Similar 
analysis leads to the conclusion that the switched system is not (asymptotically) sta- 
ble. However, it is marginally stable since it admits the following common weak 
quadratic Lyapunov function: 

(x _ 2 , (sgn(disc(Ai)) sgn(disc(A 2 )) - F 2 ) 2 ^ 2 
1 4F 2 (riF-T 2 sgn(disc(A 1 ))) 2 * 2 ' 

This proves Statements (1) and (2). 
Next, assume that 

r(A u A 2 ) > -VdetAi det A 2 , tr(AiA 2 ) > -2-y/detAi detA 2 . 

It is clear that F(Ai, A 2 ) > — VdetAi detA 2 is equivalent to \j/(a>) > for any 
a> e [0, 1]. Similar analysis shows that tr(A] A 2 ) > — 2^/detAi det A 2 is equivalent 
to det(<wAi + (1 — cl>)A2 ) > for any co € [0, 1]. It follows from Lemma 5.5 that 
the switched system is quadratically stable. This proves Statement (3). 

Finally, we proceed with the case where F(Ai,A 2 ) > —VdetAi detA 2 and 
tr(Ai A 2 ) < -2VdetAidetA 2 . Note that 

tr(AiA 2 ) < -2 v / detAidetA 2 , 

which implies that 

1 



r(Ai,A 2 ) = -(tr(A 1 )tr(A 2 )-tr(AiA 2 ))> VdetAj detA 2 . 
Therefore, we only need to consider the case where 

r(Ai, A 2 ) > ,/detAi detA 2 , tr(Ai A 2 ) < -2-y/det A\ det A 2 . 

From the normal form we compute that 

tr(A 1 A 2 ) = 2^ + 2r 1 r 2 , 

which implies that x[r < and further F < — 1. Denote Q(x) — det[A[X, A 2 x] for 
x e R 2 , and it is clear that the discriminant of Q is exactly A. Define Q — {x e R 2 : 
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Q(x) = 0}. It follows from the fact A > that Q = DiU D 2 , where D x and D 2 
are (noncoinciding) lines passing through the origin. For an x e £2 — {0}, we say 
that Q is direct (inverse, respectively) at x if A 2 x — [iA\x for some /x > (/x < 0, 
respectively). It is clear that there are real constants \i\ and \i 2 such that 

A 2 A\ l A\x — A 2 x — ixiA\x Vjc e D,-, j = l,2. 

It follows that both /xi and/X2 are eigenvalues of matrix A 2 A j~ . As a result, [i\[i 2 = 
det(A 2 A~[ 1 ) = detA2/detAi > 0. On the other hand, it follows from the fact A~[ l — 
(2ri h- Ai)/detAi that 

Ml + M2 = tr(A 2 A~ l ) = tr(2ri A 2 - A 2 Ai)/detAi 
= r(Ai,A 2 )/detAi >0, 

which implies that both /xi and /X2 are positive, i.e., Q is always direct. Furthermore, 
we can establish that 

det[Aix,x] >0, det[A 2 x,x]>0 Vx e Q - {0}, 

which implies that both At and A2 rotate clockwise at £2. 

It is clear that Dy and D 2 divide the state space into four cones, and within 
a cone the sign of Q(x) keeps unchanged. Note that, from an initial state, the 
most stabilizing/destabilizing phase portrait (along all possible switching signals) 
is achieved when switches occur at Q. To be more precise, from a nonzero ini- 
tial state xq, the most destabilizing state trajectory, denoted by (p*(t,xo), is that 
4>*(t,xo) — Ai4>*(t,xo) forms the smaller angle with the exiting radial direction 
than the other at any nonswitching time t . Note that the most destabilizing trajectory 
rotates clockwise in the phase plane, and the switched system is stable iff the trajec- 
tory is convergent (to the origin). Now take an initial state xq e D[ , and let t* be the 
least (positive) time that xi — <p*(t*, xq) e Di, Denote the ratio R — ||4. Then the 
switched system is stable (marginal stable, unstable) iff R < 1 (R = 1, R > 1, re- 
spectively). Tedious but straightforward analysis based on the normal forms shows 
that R is exactly m, and the conclusion follows. □ 



5.1.2 Application to Absolute Stability of Planar Lur'e Systems 

A typical Lur'e system consists of a linear plant with an output feedback whose 
gain is sector-bounded. Suppose that the planar linear plant is both controllable and 
stable and is described by 



x = Ax + bu 



y = cx = [a c 2 ] 



1 

-ui —a 2 

x\ 
X2 





Xl 

x 2 


+ 



1 



(5.6) 
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where a\ and 0(2 are positive real numbers. For a positive real number k, the system 
is said to be [0, k)-absolutely stable if the system is globally asymptotically stable 
under any (continuous) time-varying nonlinear output feedback law u — K{y,t) with 
< K(y, t)y < ky 2 . The problem of absolute stability is to determine the largest 
possible number k* such that the system is [0, k) -absolutely stable for any k < k* . 
If the system is [0, A:) -absolutely stable for any k, then let A:* = +00. 

Note that the absolute stability implies that, for any k e [0, &*), the switched 
system with subsystems A\ — A and A 2 = A + kbc is guaranteed asymptotically 
stable. The converse is also true. Therefore, the stability criterion presented in the 
previous subsection applies. To this end, observe that 



A + bkc- 



1 

-on + kc\ —ot2 + kc2 



which is also of the companion form. Let k* — sup k {kc\ < a\,kc2 < 012}. It 
is clear that k* < k*. Another observation is that, for any k < k*, we have 
r(A, A + kbc) > 0. According to Theorem 5.1, if k* < +00, it should satisfy the 
relationships 

tr(A(A + k*bc)) < -2j det A det(A + k* be), m = 1. (5.7) 

Take the equation 

tr( A(A + kbc)f = 4det Adet(A + kbc), (5.8) 

where A: is a variable to be determined. A solution of the equation is a root of a 
second-order polynomial, and it admits an analytical expression. Denote the two 
solutions to be k 2 and k\. If the numbers are real, then there is at most one k 2 
satisfying 

kf e (0, k*], tr(A(A + kfbc)) < 0. 

In this case, let k^ = kf. Otherwise, let k^ = k*. It follows from Theorem 5.1 that 
the Lur'e system is [0, kV) -absolutely stable. As a result, k* > k%. In the case where 
k* = k^, we have k* — k*, and the problem is solved. 

When k^ > fe|, we are to determine the k* such that the corresponding m is equal 
to one. As m relies on A: in a highly nonlinear manner, we propose a computational 
searching procedure for finding k*. As an initiation, substitute k* into a very large 
number (in the computational sense) when k* — +00 and verify whether or not k* , 
i G { 1 , 2}, corresponds to unit xu . If so, set k* :— k* , and the procedure is terminated. 
Otherwise, set kj :— kf, i — 1,2, and go to the recursive steps described in the 
following. 

Set k :— -Jk\k2 and compute the corresponding m . If uj — 1, then set k* :— k 
and terminate. Else if m < 1, then set A4 :— k. Otherwise, set A^ := k. Repeat the 
process. 

Note that in the above procedure, m — 1 should be understood to be m e (1 — e, 
tzt), where 6 > is a small number fixed in advance. 
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Fig. 5.1 Most destabilizing phase portrait 
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Example 5.6 Assume that 

a\ — o!2 = 1, 



c\ 



"3, C2 '■ 



■1. 



It is clear that A + kbc is stable for any k > 0, and we have k* x = +oo. Solving 
equation (5.8) gives k — 1 ± V7/2, Further verification shows that k^ — 1 + Vl/2 « 
2.3229. Applying the above computational procedure (with k^ — \e + 10 and e — 
\e — 8), we obtain k* — 36.5031. Figure 5.1 depicts the most destabilizing phase 
trajectory of the switched system with A and A + k*bc being the subsystems. It is 
clear that the trajectory is periodic. The switching surfaces (the dashed lines) are 
also depicted in the figure. 



5.2 Adaptive Control via Supervisory Switching 

For a control system with relatively small uncertainties or disturbances, it is possible 
to design a robust (single) controller that renders the uncertain system working well. 
However, when the uncertainties are of large scale, a robust controller might not ex- 
ist, and usually the methodology of adaptive control has to be sought. By the well- 
known Astrom-Wittenmark textbook [12], an adaptive controller is "a controller 
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that can modify its behavior in response to changes in the dynamics of the plant 
and the character of the disturbances". The classical adaptive control theory seeks a 
parameterized controller where the parameter is taking value over a continuum, and 
a controller is chosen based on the online estimate of the parameter and the princi- 
ple of certainty equivalence. While effective when the parameter enters linearly and 
the parameter set is convex, the classical approach faces severe limitations when the 
unknown parameter enters the plant in nonlinear/nonconvex ways. To overcome the 
inherent difficulties, an alternative approach known as supervisory adaptive control 
appeared since the 1980s. A primary difference between this approach and the clas- 
sical approach lies in the mechanism of controller selection, which is logic-based 
switching in the supervisory control rather than continuous tuning in the classical 
approach. The key idea behind the approach is to incorporate, besides the plant and 
the parameterized controller, a "high-level" supervisor that coordinates the switch- 
ing among the candidate controllers in the way that an optimal controller is finally 
switched on so that a satisfactory performance is achieved. For this, a monitoring 
signal is designed based on the measured input/output data, and the switching sig- 
nal is chosen to minimize the monitoring signal. In this way, suitable design of the 
monitoring signal is a crucial step toward the supervisory switching adaptive control 
diagram. 



5.2.1 Preliminaries 

Consider a single-input single-output plant with an unknown (but fixed) parameter 
described by 

y(s) = g(X,s)u(s), (5.9) 

where X e A, which is a compact subset of an Euclidean space, g(X,s) — 
oi\(s)/Px(s) is a strictly proper transfer function for each X, fix is monic, ax and 
fix are coprime, and g(X, s) depends continuously on X in the sense that the coeffi- 
cients of polynomials ax and fix depend continuously on X. The plant with transfer 
function g(X, s) is denoted by P^. We denote by A* the (unknown) true parameter, 
and P x (or P in short) the true plant. 

We are to address the problem of adaptive stabilization within the supervisory 
adaptive control scheme. To this end, we need a feasibility assumption as follows. 

Assumption 5.1 For each X € A, a stabilizing controller C^ exists for process P^. 

Note that, when controller C^ stabilizes plant P^, it also stabilizes any plant P M 
when n is sufficiently close to X. This, together with the facts of continuous de- 
pendence of X in P^ and compactness of A, implies the existence of a finite set of 
parameters {X[ , . . . , Xjc] and a related set of stabilizing controllers {Ci , . . . , C&} such 
that U?=i A ' ' — A > where A' ={XeA: Q stabilizes P x }. 
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Next, we present a constructive way of determining a finite set of stabilizing con- 
trollers. For a plant P and a controller C, let T(P, C) be the closed-loop generalized 
sensitivity transfer function matrix defined by [254], 



T(P, C) = 



1 



-PC P 
-C 1 



1-CP 

For each X e A, we can find a stabilizing controller C^ for plant P^ such that 

|T(P,,Q)|L = 



<*x,|2 



(5.10) 



where || ■ ||oo denotes the Hoc norm, and || ■ ||h the Hankel norm. On the other hand, 
controller C^ stabilizes any plant with transfer function a(s)/fi(s) when 



otx-u 



T(P A ,C A ) 



< 1. 



Fix sufficiently small positive real numbers e and S. 

Procedure for Calculating a Finite Set of Stabilizing Controllers 

(1) Grid the parametric set A into T = {Ai , . . . , Aj} uniformly distributed with ra- 
dius S. 

(2) For each X e T, calculate controller Cx that satisfies (5.10) and estimate the 
parametric subset 



A' 



= 1 
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(3) Verify the coverage A C U Aer A . If yes, go to Step (4). Otherwise, set 
S := 8/2, and go back to Step (1). 

(4) Prune T as long as coverage is kept. 

In the above procedure, the major computational load is the estimate of the para- 
metric subset in Step (2) and the coverage verification in Step (3). Due to the con- 
tinuous dependence of the process on the parameter, the parametric subset admits 
nonempty interior; hence it is possible to approximate the set by means of a (con- 
vex) polyhedron. In this case, the coverage verification can be made by means of 
numerical softwares such as MATLAB GBT Toolbox [252]. 

In the sequel, we assume that the procedure is carried out successfully, 
which returns a finite parametric set {k\, . . . , !&}, the corresponding controller 
set {Cij , . . . , C^}, and stabilizing region set {A kl , . . . , A Xk } with A C [J* =1 A Xi . 
Each process P^ is said to be a nominal model that represents a family of systems 
Px : X e A ' . The stabilizing controller set {C^, , . . . , Cx k ] is said to be the candidate 
controllers for the plant. For notational convenience, redenote P^, by P; , A ' by A' , 
and Cx f by C, for ;' = 1 , . . . , k. 
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Fig. 5.2 Supervisory switching diagram 



5.2.2 Estimator-based Supervisory Switching 



As we are to find a supervisor that coordinates the switching among the candidate 
controllers such that the closed-loop system is stable, we need to design a switch- 
ing law based on measured input/output data. Heuristically, if the plant parameter 
X* is known to belong to a parametric subset A' , setting the switching signal to 
constant i* could achieve the desired performance. However, as the plant parameter 
is unknown, we have to introduce a "monitoring signal" based on measured data 
and then design a monitoring-signal-driven switching law. For this, we incorporate 
a multiestimator whose outputs are signals y,-, i e {1, . . . , k}. When the right (/*th) 
controller is switched into the loop y,-* would asymptotically converge to y, the plant 
output. The estimation errors e, = y; — y are a key in producing the monitoring sig- 
nal in a suitable manner. 

To summarize, the supervisory switching scheme consists of (1) a multiestimator 
E with input (u, y) and outputs yi, i G {1, . .., k}; (2) a monitoring signal generator 
M with inputs e,- and outputs /li,- called monitoring signals; and (3) a switching logic 
S with inputs /li, and output a. The system diagram is shown in Fig. 5.2. 

First, for every i G {1, . . . , k], let 



x c = Afx c +bfy, 
u — h-ac +ny 



(5.11) 
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be a realization of controller Q, all sharing the same state Xc, where Af is stable, 
and 



Xe — A xe + by + d u, 

yi = cjx E 



(5.12) 



be a realization of the estimators, all sharing the same state xe- Note that A E , b E , 
and d E can be chosen to be parameter-independent with A E stable. By defining the 
composite state x — [ V| f], we have the system equations 



where a e { 1 , . 
and 



y = [ci* 0]x - ei* 
u = f a x + g a et*, 



(5.13) 



, k) is the switching signal, e a — y a — y is the estimation error, 



A h + (b E + d h n) Ci d E h 



bfa 

b E +d E n 

bf 

fi = [ria hi], 

Pi — -n, / = !,. 



As C, stabilizes P,- for each i = 1, . . . , k, there exists a positive real number Ao such 
that all eigenvalues of A, 's are on the left of the vertical line s — —Xq on the complex 
plane. On the other hand, as Q* robustly stabilizes the plant set {P^ : k e A 1 }, the 
error e,* converges exponentially when the "right" controller is switched onto the 
loop. This means the existence of a positive real number X\ such that 



k*(0 <$\e 



-kt 



(5.14) 



for any X < X\, where &i is a constant relying on the initial condition. This further 
implies that 



Jo 



e 2kT el(r)dr <& 2 



(5.15) 



for any X < Xi, where &2 is a constant relying on the initial condition. Fix a X < Xo 
such that both (5.14) and (5.15) hold. 
Then, define the monitoring signal to be 



m(t)-- 



■ / ej{x)di 
Jo 



(5.16) 
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where 6;, i — 1, .. ., k are positive real numbers. Note that the monitoring signal is 
a solution of the differential equation 

A/(0 = <?, 2 0), Ai/(0) = e,-. 

It is clear that the monitoring signal is the C? performance w.r.t. the (virtue) out- 
put error and is strictly increasing and positively lower bounded. Constants e;, 
i = 1, . .. , k, are decided by the designer according to the prior experience which 
measure the possibility that the ith controller stabilizes the true plant, or otherwise 
arbitrarily chosen. 

Next, fix a hysteresis factor h > and define the switching signal recursively by 

0+1 =min{f >tj : (I + h)minUi(t), . . . , fi k (t)} <Mo-(,.)(0}, 

' (5.17) 

c(0+l) = ar g min {Ml(0'+l)' ' ' ■ ' Vkitj+l)} 

for j = 0, 1, 2, .. ., where initially to — and a {to) = argminfei, . . . , e,t}. When 
there are two or more indices achieving the minimum, just choose one arbitrarily. 
It is clear that the switching law is scale-independent in the sense that, when the 
monitoring signal is scaled by (9(0 with (9 a positive function, the switching signal 
will keep unchanged. 

Finally, we briefly analyze the system performance for the supervised uncertain 
system. For this, we need a technical lemma as follows. 

Lemma 5.7 For any t > 0, the number of switches N t within [0, t ) is upper bounded 
by 

ln(l + «) \mmj€jj 

Proof Let (to, f'o)> •• •> (tff t , j'jv ( ) be the switching sequence in [0,0- Denote 
f/V, + i — t. From the switching law we have 

^(t)<(l + h)iMj(t) V/ = N t , 7 = 1 *, te[t h ti +1 ], (5.19) 

and 

Wi(.ti)<Hj(fi) V/ = 0,...,JV». 

In particular, it follows from (5.19) that 

Hhdl+l) < (1 + h)w l+i (ft+i) VI = 0, . .. , AT, - 1. 

Let s be the most frequently appeared index in the set {f'o, ... , /a?,}. It is clear that 
there exist a natural number v > \(N t — l)/k~\ and integers < /ci < Ki < ■■ ■ < 
k v < N t such that i K , — s for j = 1, ..., v. When v < 1, inequality (5.18) is trivially 
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true. Suppose that v > 2; then we have 

(1 + h)fi s (t Kj ) < (1 + h)in K . +l (t Kj ) < (1 + h)m Kj+1 (t Kj+ i) 
= M^+i) < Li s (t Kj+1 ) V/ = 1, ... , v - 1, 

where the relationship t Kj+ \ < t K +1 and the monotonicity of ji j 's have been utilized. 
As a result, we have 

iii*(t) > m*(t K j > /x.fej > (i+A) v ~V*(««i) 

> (1 + /z) y " V,«0) > (1 + /! ) y_1 mine./, 



which implies that 



v<i + _ l_ ji^wy 

ln(l + /z) \winj€jj 



As iV( < A:v + 1, inequality (5.18) follows. □ 

It follows from the lemma and inequality (5.15) that 

N t <l + k+— -In' " 



ln(l + h) \ min, e, 

which is a finite number independent of t. As a result, there exist an index j* and a 
time T* such that a{t) — j* for t > T*. By the switching law, we have 

lMO<(l + A)W*(O<(l + A)(02 + e,-.), 

which means that e ; * e £ 2 . As Ay* is stable and e,* e £ 2 , it follows from relation- 
ship (5.13) that y — >• 0, and all other signals are bounded. 
To summarize, we have the following conclusion. 

Theorem 5.8 All the signals in the closed-loop system remain bounded for any 
initial conditions, and y(t) — >• as t — > +00. 

Remark 5.9 As in the traditional adaptive scheme, the identified parameter j* is not 
necessarily the "true parameter" i*. In general, as we do not exclude the possibil- 
ity that more than one candidate controller stabilizes the true plant, the identified 
parameter may be initial-condition dependent. Another observation is that, though 
the supervisor can coordinate the switching to a final (stabilizing) controller in a 
finite time, it cannot prevent a destabilizing controller from connecting to the loop 
more than one time. This means that the switching frequency may be high during 
the identifying process, which may worsen the transient performance as switching 
itself is usually undesirable. 
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5.2.3 An Example 
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Let the set of plants be 



A • 



?(*,*) = 



Hs - 1) 
(s + iKs-2y 



XeA = [l,40]. 



(5.20) 



It is clear that all the plants are unstable and nonminimum phase systems. The large 
parameter uncertainty excludes the possibility to design a single, fixed-parameter 
linear controller that regulates the system in a satisfactory way. 

It follows from the standard frequency domain theory that, for any fixed A. € A, 
a stabilizing controller can be chosen to be 



c k = r 



! 448s 2 + 450s- 18 
3LsO-9) ' 



As the unknown parameter is a scalar multiplicative gain in the system, we take 
Xj — y'~ { for j = 1, ... , k, where y > 1 should be chosen such that A x i covers 

the interval [—/=, +/y^-j] for any j — l,...,k, which is confirmative if 



o-i 



T(Pi,Ci) 



< 1. 



Simple calculation shows that y — 1.2 satisfies the requirement. As a result, we can 
choose k — 21 and 



Xj = 1.2 



/-i 



7 = 1. 



This corresponds to 21 candidate controllers Cj with Cj = l^ 1 "^' 448 ^ 50 ^" 18 , 
j — I, ... ,21. For any j = 1, . . . , 21, the controller C/ stabilizes the set of plants 

P l v/iihXe[^ m Xj,Vh2Xjl 

Next, we construct a supervisor that coordinates the switching among the candi- 
date controllers. For this, note that the jth estimator can be chosen as 



k E = 


" 
-1 


1 " 

-2 


x E +' 


1 " 

-3 


y + 


' 3 " 
-3 


yj = [Xj 0]x E , 


and the jth controller can be realized by 


i c = 


"9 1" 



x C + 


" 144.5806 

0.5806 
L X J 


y, 




A — 


1 0] 


x c + b 


4.451 


6y. 
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Fig. 5.3 The closed-loop state trajectories 




Fig. 5.4 The input and output trajectories 
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Fig. 5.5 The switching signal 



To proceed with simulation, assume that the true parameter is 4 and that the true 
plant can be realized by 



x p 



1 

-1 -2 



1 



u, 



y = [4 0]x' 



In addition, the factor h in the switching law (5.17) is set to be h =0.1. 

Let the initial state of the true plant be x p (0) = [ 1 , — 1 ] T , and both the candidate 
controller and the estimator be initially at the origin. Suppose that the first candidate 
controller is connected into the loop initially, that is, er(0) = 1. Figures 5.3 and 5.4 
depict the closed-loop state and input-output trajectories, respectively. These exhibit 
satisfactory closed-loop performance, though the convergence rate is quite low due 
to the fact that A,* has an eigenvalue at —0.0825, which is very close to the imag- 
inary axis. The switching signal is shown in Fig. 5.5, which identifies the "right" 
controllers via 5 switches in 1 sec. It is interesting to note that, before the final 
identification of the right controller, the controller had been connected to the loop 
but disconnected after a while. This indicates that the switching mechanism fails 
to identify the right controller even if it is connected to the loop. Furthermore, we 
set the right controller initially, i.e., er(0) = i* — 9, and carry out the simulation 
again. The switching signal in Fig. 5.6 exhibits that the finally identified controller 
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Fig. 5.6 The input-output and switching signals 

is not the "right" controller. This is not surprising due to the fact that the identified 
controller is a stabilizing controller for the true plant. 



5.3 Stability Analysis of Fuzzy Systems via Piecewise Switching 

Fuzzy systems and fuzzy logic control have gained much attention due to their 
wide applications to many areas including machine intelligence, signal processing, 
and management, to list a few. As an alternative of the conventional control de- 
sign methodologies, fuzzy control is powerful in dealing with nonlinear dynamical 
systems. However, the development of systematic methods for analysis and con- 
trol of fuzzy systems has proven to be very hard. In particular, quadratic stability 
analysis leads usually to conservativeness, and nonquadratic analysis may result in 
intractable computational burden. 

In this section, we examine a special yet typical class of fuzzy systems, which 
was known to be linear Takagi-Sugeno systems or the T-S fuzzy model in short. 
A forced-free T-S system is described by a set of rules in the form 



R z : IF zi is F\ AND 



7' 



, .,.,.,., -• ANDz s isFj, 
THEN x(t + 1) = Aix(t) + a,, 



(5.21) 
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where R z denotes the Zth fuzzy inference rule, / e M — {1, . . . , m}, FJ, I — 
1, . . . ,m, i — I, . . . ,s, are fuzzy sets, x(t) e R" is the state, zt, i — 1, . . . , s, are 
measurable variables of the system, and (A/, a/) is the /th local model. By the stan- 
dard fuzzy inference, the inferred system can be written as 

x(t + 1) = A(ix{x))x{t) +a(ix{x)), (5.22) 

where 

m m 

A(/U,) = ^/x/A;, a(ii) = y^niai 

1=1 1=1 

yts pi 

with in — - \ ' — j. It is clear that /x; > for I e M and that J2ieM W = 1- 

Therefore, A(/x) is always a convex combination of the matrices A\, . . . , A m . When 
the affine term vanishes, and A\ , . . . , A m admit a common quadratic Lyapunov func- 
tion, the fuzzy system is globally exponentially stable. While simple, the idea may 
lead to very conservative criteria. Indeed, as the membership functions are state 
dependent, the common Lyapunov function approach does not utilize this useful in- 
formation. To tackle this problem, we introduce a general framework of piecewise 
switched linear systems and conduct stability analysis for the systems. The approach 
is then applied to stability of T-S systems. 



5.3.7 Piecewise Switched Linear Systems 

Piecewise switched linear systems are piecewise dynamical systems with switched 
linear systems as local dynamics. Such a system may represent, for instance, a non- 
linear process where approximate linearization is taken at different operating points, 
and the approximate error and other perturbations are taken into account as pa- 
rameter/structural uncertainties. From a system framework's perspective, piecewise 
switched linear systems extend both switched linear systems and piecewise linear 
systems. 

A discrete-time piecewise switched linear system can be described by 

x(t + l) = A ita .x(t) + ai ttTi for x(t)e£2i, (5.23) 

where x{t ) e R" is the state, S2\, . . . , Q% are convex polyhedra with the union be- 
ing the state space, o - ,- e {1, . . . , m{\, i = 1, . . . , k, and A,- ,• e R" x " and atj 6 R", 
j = 1 , . . . , m, , i = 1 , . . . , k, are real constant matrices and vectors, respectively. For 
treatment convenience, the system can be restated to be 

x(t + 1) = Ai iai x{t) for x(t) e £2t, 
where A,j = [ ' J a '.'\ j = 1, . . . , m;, i = l,...,k, and x = [ *]. 
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We assume that the system is well denned in the sense that a unique solution 
exists and extends to infinity in time for any initial condition and switching signal. 

While several stabilities can be defined for the system under various switching 
mechanisms, here we focus on the (guaranteed) global exponential stability which 
means that any state trajectory exponentially converges to the origin under arbitrary 
switching. 

Take the Lyapunov candidate as 

V(x)=x T P i (x)x + 2q i (x)x + r i (x)=x T P i (x)x, xeQ h (5.24) 

where P, = [ ' q * ] . When e Q, ■ , we require that </, = and r, = 0, which means 

that V (x) — x T Pi (x)x for x € J2,\ Assume that V(x) is continuous in each J2,- , i — 
1, . .., k. Note that we do not impose the continuity of V(x) over the cell boundaries. 

Proposition 5.10 The piecewise switched linear system is globally exponentially 
stable if there is a Lyapunov candidate V as in (5.24) satisfying 

(1) for any i — 1, . . . , k, there exist positive real numbers otj and fy such that 

otiX T x < V(x) < PiX T x Vx e Qi (5.25) 

(2) for any i = 1, . , . , k, there exists a positive real number yi such that 

x T AfjPi(Aijx)Aijx - x T Pj(x)x < -yjx T x 

Vx eQj, j = l,...,m,-, (5.26) 

where I — arg{/x : A,- jx € 42^} 

Proof The proof is straightforward. Indeed, let 

a — min at, f> — max f>[ , y — min y, . 

i i i 

Taking an arbitrarily given state trajectory x(t), t = 0, 1, 2, . . . , it can be seen from 
Item (2) that 

V(x(t + 1)) <(l- j\v(x{t)) W = 0, 1, 2, ..., 



which, together with Item (1), implies that 

, , /p7 Y\"\ , 

\xit) <,/- 1-- U(0) Vf = 0,1,2,.... 



a\ fJ 



D 



Remark 5.11 Note that x r ,P,(x)x is a common Lyapunov function for A (/ , y = 
1 , . . . , mi over the cell Qj . When P, (x) = P; is a constant matrix, the subsystems of 
the ith local model admit a common quadratic Lyapunov function. When the sub- 
systems do not admit such a common Lyapunov function, we could seek piecewise 



218 5 Connections and Implications 

quadratic ones instead. To verify the proposition, we need to examine one-step cell 
transitions of the state, that is, to determine the indices of the cells that Ajjx belong 
to for any x e £2, • , j = 1, . . . , m, , i — 1 , . . . , k. 

To search a qualified Lyapunov candidate that satisfies inequality (5.25), we take 
the parameterization in terms of polyhedral cell bounding, as presented in Sect. 3.3. 

Proposition 5.12 Suppose that Ej — [E{,ei], i — l,...,k, are polyhedral cell 
bounding matrices. The piecewise switched linear system is globally exponentially 
stable if there exist symmetric matrices P\, . . , , P^ satisfying 

(1) for any i = 1, . , . , k, there exists a matrix Wj with positive real entries such that 

P i -E?W i E i >0 (5.27) 

(2) for any i = 1 , . , . , k, there exists a positive real number yi such that 

x T AfjPiAjjx — x T Pjx < —yjX T x 

Vxe£2 h j= l,...,m/, (5.28) 

where I — arg{/x : Aijx € £2^} 

The proposition could be proven by simply combining Proposition 5.10 with 
Theorem 3.23. The details are omitted. 

Remark 5.13 The above criteria are much less conservative than the existence of a 
common quadratic Lyapunov function, and they could be verified by means of linear 
matrix inequalities. However, to find qualified piecewise quadratic Lyapunov func- 
tions, we usually need to further partition the cells, which makes the computation 
inefficient for higher-dimensional systems. 



5.3.2 Stability Analysis ofT-S Fuzzy Systems 

A T-S fuzzy system (5.22) can be aggregated into a piecewise switched linear sys- 
tem in a clear manner. Indeed, suppose that £2\, . , . , £2^ partition the state space. 
Define 

£,■ = {j : 3x e Q t s.t. /jlj(x) > 0}, i — 1, . . . , k, 

that is, C,i is the set of indices of the normalized membership functions that do not 
vanish in the region ,£?,. Let m, be the cardinality of the set £,-, and denote the 
corresponding set of subsystem matrices by A,j, ... , A lm and the affine terms 
by Cj t i, . .., «j,m,! respectively. The corresponding piecewise switched linear sys- 
tem (5.23) is said to be the aggregated system w.r.t. partition {£2\, ,,., £2^}, 
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Lemma 5.14 Suppose that Q\, . . . ,Q^ partition the state space. T—S fuzzy sys- 
tem (5.22) is globally exponentially stable if its aggregated system is globally expo- 
nentially stable. 

While simple and straightforward, the lemma provides a general approach for 
verifying the stability of a T-S fuzzy system. By appropriately choosing the state 
partition, the approach may lead to less conservative stability criteria. For this, we 
need to find a minimum partition {Q*, ..., J2|*} in the sense that, for any / and j, 
either m(x) ^0 Vie Q*. or /x/(x) = in £2*.. A minimum partition can be cal- 
culated from the supporting sets of the normalized membership functions. In fact, 
denote T, = {x : pi(x) > 0} for i — 1, . . . , m and by Tf the complement to 7). 
Then, each Q* is exactly an intersection of some T, 's and Tf's. In particular, in the 
regions where p.\ — 1 for some /, all other membership functions are equal to zero. 
We will call such a region an operating regime. In between operating regimes, there 
are regions where < /x/ < 1 , and these regions are called interpolation regimes. 

Example 5.15 Suppose that a T-S fuzzy system is with local modes 



Ai = 



A 2 . 



A 3 = 



"-0.9425 


0.4308" 




0.2132 


0.2615_ 


' 


"-0.2821 


-0.6661" 


0.7458 


0.9664 


"0.1133 


0.9112 " 




0.2925 


-1.5132 


' 



a\ — 



a-2 ■ 



A3 = 



-0.4111 
0.6656 





-1.1257 
0.9847 



and normalized membership functions are scheduled by variable x\ as 



Mi(*i) = 



M2(*i) : 



1 




if x\ 


<-5, 




Ui 


+ 3)/2 


if - 


5 < x\ 


< 







otherwise, 





ifjci<-5, 

(5 + jq)/2 if-5<jq<-3, 

1 if-3<xi<l, 

2 — x\ if 1 < x\ < 2, 
otherwise, 



M3(*i) : 



if xi < 1, 

x\ — \ if 1 < x\ < 2, 

1 otherwise. 



By partitioning the state space into five regions as shown in Fig. 5.7, the fuzzy 
systems can be aggregated into a piecewise switched linear system, where Q\, Q-$, 
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1 - 



-1 - 



a 



Q 



a. 



n 



«. 



-10 -8 -6 -4 -2 

Fig. 5.7 The membership functions and state partitions 



£?5 are related to single local modes (Ai, «i), A%, and (A3, 03), respectively, while 
Q2 and Q4 are related to mode pairs {(Ai, a\), A2} and {A2, (A3, 03)}, respectively. 
By searching piecewise quadratic Lyapunov functions in form (5.24) that verify 
Proposition 5.10, we obtain 



Pi = Pi = 

n = r 2 = 1.3 152 

P 3 = 



1.0934 0.0216 
0.0216 0.8491 



3.4437 1.3694 
1.3694 2.3554 



Pa = P5 



5.9608 2.4491 
2.4491 1.8491 



qi = q2 = [0.6570, 0.7234], 

93 = [0,0], r 3 = 0, 

?4 = 35 = [-1.7496, 0.5635], 



r 4 = r 5 = 3.7524. 

By Lemma 5.14, the fuzzy system is globally asymptotically stable. The level sets 
of the Lyapunov functions and the sample phase portrait are depicted in Fig. 5.8. It 
is clear that the Lyapunov function is not continuous over the region boundaries. 



5.4 Consensus of Multiagent Systems with Proximity Graphs 



221 



10 



-10 



-15 




-10 



Fig. 5.8 A sample phase portrait with level sets 

5.4 Consensus of Multiagent Systems with Proximity Graphs 
5.4.1 Introduction 

A multiagent system is a collection of physical or virtual entities, each with the 
abilities of acting and perceiving the environment (possibly in a partial manner) and 
communicating with others. A typical example is a school of migrating birds that 
stay together, coordinate turns, and avoid collision with obstacles. A bird is capable 
of adjusting its speed and flying toward the center of the flock within its sight. The 
motion of an individual bird can be mathematically described by 

xt(t)= Yl (*/(0-*i(*)). 

where i is the bird's label, xt is the physical state (w.r.t. a fixed coordinate), and Wj 
is a neighbor set of the bird, i.e., the set of birds within its sight. Let r, be the sight 
radius of the bird. Then, the neighbor set is 



M = {j^i:\xj-Xi\<ri} 
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Suppose that there are m agents in the flocking system and that the agents are 
with a uniform radius of perception, i.e., r,- = r for all i = 1, . . . , m. The multiagent 
system is thus represented by 



Xi (t) = J2 (Xj (t)-Xi(t)), 1 = 1, 

\xj(t)-x t (t)\<r 



(5.29) 



where jc,- e R" , ; — 1 , . . . , m . Note that the system is exactly a piecewise linear 
system where the switching surfaces are the hyperplanes 

H tJ = {[xl ..., xlf e R mn : \x t -xj\=r], i jt j 

and their intersections. For any fixed x — [xj , . . . , x^] T € R m ", there corresponds 
a sequence of neighbor sets Mf , . . . , A/jJj with 



Define 



and 



M? = {j'£i:\Xj-Xi\<r}, j = l, 
£2{x) = [yeR mn :N? =Nf, i = \, 

A(x) 



where 



A 


11 (x) ... 


^lmW 


A m i(x) ... 


-^mm (.-£) 




In 


ifjeM?, 




-\M?\I n 


ify = «', 




Unxn 


otherwise, 



AyW = 



and | A/"* | is the cardinality of the set A/!* . It is clear that we can reexpress the system 
equations as 



x — A(x)x — (A(x) <g> I n )> 



(5.30) 



where 



A(x) 



A n (x) 



Alm\ x ) 



A U (X): 



y^-mXxX) ■■■ A mm {X) 

Note the following equivalencies: 

(A/?, . . . , Mi) = {M{, ...,Ml) <=► n(x) = £2{y) 



1 HjeM*, 

-|A/?| if j = i, 
otherwise. 



A(x) = A(y). 



As Mf C {1, . . . ,m) for any i — 1, . , .,m and x e R m ", the value space of sequence 
(A/*, . . . , M£) admits a finite number of elements (up to n^o ^' e l ement s). As a 
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result, there exist a finite number of polyhedra Qi, . . . , £2^ that partition the state 
space in the sense that [jf =i i2j = R m " and Q k n Q° — for all k ^ j and that any 

£2(x) belongs to the partitioned polyhedra set, i.e., Q(x) e {£2\, ... , £2n}- Let A' 
be the matrix A(x) corresponding to Q- t . The multiagent system can be rewritten as 

x = (A-> ® I n )x, xeQ h (5.31) 

which is exactly a piecewise linear system. 



5.4.2 A Consensus Criterion 

For multiagent system (5.31), an interesting problem is to find conditions under 
which the agreement can be achieved in a certain sense. More precisely, for a system 
motion x(-), let V t = (G, T t x ) be the dynamic graph, where G = {1, . . . ,m} is the 
set of nodes, and T t x C G x G is the set of edges at t, 

r t * = {(i,j):j^i, |jc,(0-*i(0|<r}. 

For a node i , the set of neighbors at t is 

M?(t) = {j ¥= ' ■ («, j) G r*} = {j ± i : \xj(t) - Xi (t)\ < r). 

Nodes i and j are said to be agree at time t if x t (t) — xs it) . The motion is said to be 
in consensus at t if any two nodes agree at t. The motion is said to be in asymptotic 
consensus if consensus is achieved asymptotically, i.e., \m\ t ^ +00 (xj(t) — x jit)) — 
for all i, j e G. In particular, when the limit ]im J ^.-^ 00 Xi(t) exists, the consensus 
limit is said to be the group decision value. If it happens that the limit is equal to the 
algebraic average of the initial state, i.e., lim^+oo x t (t) — — Y17=\ x i ( ? o)> then the 
average consensus is achieved. 

The multiagent system (5.30) is equivalently represented by its dynamic 
graph in the following sense. Let B(t) — [bij(t)] mX m be the adjacency matrix 
of graph Vt, that is, bu(f) — 1 if (i, j) G Y t , and bjj(t) — otherwise. Let 
C(t) — diag(ci (t ),..., c m (t)) be the valency matrix with c,(?) = ^2f—ibij(t), 
i — l,...,m. Furthermore, define the graph's dynamic Laplacian matrix to be 
L(t) = C(t) — B{t). Note that V t is an undirected graph for any t and that the ad- 
jacency matrix is a symmetric matrix, so is the Laplacian matrix. Correspondingly, 
a motion x (■) of the multiagent system satisfies 

x(t) = -(L(t)®I n )x(t). (5.32) 

The system is a piecewise linear system with the system matrices all being graph 
Laplacian matrices. As a result, the properties of the Laplacian matrices play an 
important role in analyzing the system behavior. Fortunately, the well-developed 
algebraic graph theory (see, e.g, [28, 89]) provides a rigorous tool for this. 



224 5 Connections and Implications 

Fix a (undirected) graph V — (G,T), and suppose that its Laplacian matrix is L. 
It is clear that L is symmetric; hence all its eigenvalues are real. We denote the 
spectra to be 

A-i < A.2 < •• • < A m . 

An observation is that the matrix is row-stochastic, that is, the sum of elements in 
each row is zero. As an implication, zero is an eigenvalue with eigenvector 1 = 
[1, . . . , 1] T . This further implies that l T x(t) is a constant independent of the time. 
As the matrix is row-dominated by its diagonal entries, it is in fact semi-definite 
positive. Combining the above analysis gives k\ = 0. A, 2 is called the algebraic 
connectivity, and the smallest nontrivial eigenvalue is called the spectral gap. 

Lemma 5.16 (See [28]) The multiplicity of zero as an eigenvalue of L is exactly the 
number of largest connected components of the graph. 

As a corollary, the algebraic connectivity is the spectral gap if and only if the 
graph is connected. In this case, rank L — m — l. 

With the above preparations, we are ready to prove the main result of this sub- 
section. 

Theorem 5.17 Multiagent system (5.30) achieves asymptotic average consensus if 
the associated dynamic graph is always connected. 

Proof Note that, without loss of generality, we can assume that the system is one- 
dimensional. In fact, by denoting y-> — [xj , . . . , x,J,] r , j — 1, . . . , n, with x{ being 
the jth entry of vector x\ , we can rewrite system (5.32) into 

yi = -L(t)y J , j = l,...,n. 

The consensus of the multidimensional system is thus converted to that of a set of 
one-dimensional systems. 

Let a = X!T=i x i(0)/ m be the average of the initial states, and S = [xi — a, 
. . . , x m — a] T be the group disagreement vector. It follows from L(t)l — that 
8 — —L(t)S. Define the Lyapunov-like function 

V(8) = 8 T 8. 

Simple calculation gives 

= -28 T L(t)8 < -2X 2 {L(t))V < -2A.|V, 

where the fact that 8 T \ — has been used, and X^ is the smallest algebraic con- 
nectivity of the Laplacian matrices Lit). Note that this number is positive since 
L(t) e {—A\ , . . . , — A m }. As a result, 8 — ► as / — ► +oo, and the consensus is thus 
established. □ 
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Remark 5.18 The theorem provides an elegant criterion on consensus of the multi- 
agent system (5.30) in terms of connectivity of the associated dynamic graph. This 
exhibits the power of the algebraic graph theory in the analysis of multiagent con- 
sensus. In particular, for one-dimensional systems, the sufficient condition is also 
necessary due to the fact that any disconnected agent at a time will be isolated for 
any forward time. However, graph connectivity is not necessary for two- or higher- 
dimensional systems. 



5.4.3 A Verifiable Criterion 

The criterion in Theorem 5.17 is not verifiable since it requires graph connectiv- 
ity at all times. As multiagent system (5.30) is piecewise linear with autonomous 
switching, the connectivity relies totally on the initial agent locations. By applying 
the idea of graph transition analysis introduced in Sect. 3.3.4, we present here a 
verifiable consensus criterion in terms of initial network connectivity. 

Let Kj (t) denote the degree of node i at time t, i.e., kj (?) = |A/j- (t ) | . The dynamic 
network is said to be initially connected if the static graph (G, T(0)) is connected, 
and throughout connected if the graph (G, T(t)) is connected for any time t e %. 

Define the Lyapunov-like function 

*^j I T 1 

V(x) = max { (x { - Xj) (x t - x/): \x t -xj\<r\, (5.33) 

i.j = \,...,m 

which is the largest square distance of the connected edges. When no edge exists 
in the graph, let V(x) — +oo. It is clear that V(x) is always positive unless all x;'s 
coincide with each other. The function is continuous as long as the interconnection 
relationship keeps unchanged, that is, when neither new edge is added nor old edge 
is disconnected. 

Let x{t) be the motion of the multiagent system. 

The following lemma states a monotone condition for V (x(t)) that will be used 
later. 

Lemma 5.19 Suppose that 

(xi(t)-Xj(t)) T ( J2 fait) - Xi(t)) - J2 (**(') -*j(0))<0 

\&Wi(t) keAfj(t) ' 

V(i,j) s.t. \x t (t) -Xj(t)\ —ma.x{\xk(t) - xi(t)\: (k,l) eT(f)j 
VreT . (5.34) 

Then, V(x(t)) is nonincreasing as long as the interconnection relationship keeps 
unchanged. 
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Proof Under condition (5.34), function V is nonincreasing as its derivative is non- 
positive. As a result, the maximum edge length does not increase when no new edge 
is added. This leads directly to the conclusion. □ 

Remark 5.20 The monotonicity of V (x(t)) means that, while a connected edge can 
generally become longer in length, the maximum edge length is always decreasing. 
A simple yet useful observation is that, if V(x(t)) is nonincreasing as long as the 
interconnection relationship keeps unchanged, it is possible that one or more new 
edges will appear, but no existing edge will be disconnected. In this case, V(x(t)) 
is always right-continuous, and the number of discontinuities is finite (in fact, upper 
bounded by m{m — 2)). Therefore, if V (x(t)) is always nonincreasing except at the 
discontinuous instants, then any initially connected network will keep connected for 
all the forward time. 

Next, with the aid of Lemma 5.19 and Remark 5.20, we are able to establish the 
main result of this subsection as follows. 

Theorem 5.21 Suppose that the multiagent system is initially connected and satis- 
fies 

Ki+iCj> 3 -m-2 V(/,;)eT (5.35) 



and 



Ki + Kj > ^ " 4 V(/, ;) ?r,i^ j, (5.36) 



at the initial time. Then, the network is throughout connected, and the asymptotic 
average consensus is achieved. 

Proof First, pick up any node pair (i, j) with i ^ j , let vj be the number of nodes 

(excluding i and j) that connect to both i and j, and if be the number of nodes 
(excluding i and j) that connect to i but disconnect to j. It is clear that, among the 
m — 2 nodes except for i and j, there are Ki — 1 that connect to i, and there are 
Kj — 1 that connect with j . According to the Pigeonhole Principle, the number of 
common neighbors of i and j, vj , satisfies the inequality 

vj > (ki - 1) + (kj - 1) - (m - 2) = Ki + Kj - m. 
Similarly, we have 

d — (^ — 1) — vj < m — Kj — 1 
and 

l'j = (Kj - 1) - vj < m - Ki - 1. 
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Second, observe that, under the conditions of the theorem, we have 

v{ +m>Ki+Kj>3m-(Ki+Kj)-4 V(i, j) e T (5.37) 

when the network has the same connectivity as in the initial time. Note that inequal- 
ity (5.37) further implies that 

vj + 2>2m- (Ki + Kj) - 2 

— (m — Kj — 1) + (m — Kj — 1) 

>ij + t'j V(i,i) 6 r. (5.38) 

Third, pick any two connected nodes i and j with 

\xi —xj\ — max{ \%k — x\ \ : (k, I) e T}. 
It can be seen that 

^2 (x k -x^- ^2 (x k - Xj) 

ksMi keMj 

= (2+ vj)(xj - Xi) + ^ ( x k - Xi) - ^2(xk~ Xj), 
k€fj kef) 

where rfri is the set of nodes (excluding i and jf) that connect to i but disconnect 
to j . It follows that 

(Xj 



o T ( X! (** -xd- ^2 c** ~ *j) ) 



K keNt keNj 

<-(2 + m{- i{ - i'j)\xi - xj | 2 < (5.39) 

when the network has the same connectivity as that in the initial time. 

Finally, suppose that the multiagent system is initially connected and relationship 
(5.35) initially holds. Then, it follows from (5.39) and Lemma 5.19 that each edge 
will keep connected until new edges add into the network graph. A further implica- 
tion is that each node degree is nondecreasing and inequality (5.35) still holds for old 
edges. On the other hand, inequality (5.36) guarantees that each newly added edge 
also satisfies (5.35). The above reasonale shows that relationships between (5.35) 
and (5.36) hold for all forward time, which further implies throughout connectivity 
under the assumption of initial network connectivity. It follows from Theorem 5.17 
that the system achieves asymptotic average consensus. □ 

Remark 5.22 The theorem presents an easily verifiable sufficient condition, which 
only relies on initial network graph, for consensus of the multiagent system under 
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the linear feedback protocol. It is interesting to note that the set of initial configu- 
rations under the theorem condition is in fact invariant and attractive. To be more 
precise, define the region 

x:Vi?j,#{kt(.i,j):\xt-x k \<r} 

, i 3 

+ #{kg(i,j): \Xj -Xk\ <r\> -m- 

where #{•} denotes the cardinality of a set. The region is attractive in that, once the 
multiagent system state enters into the region, it will never leave the region for any 
future time. Moreover, any consensus state trajectory must enter into and stay inside 
the region due to the fact that the consensus equilibrium is an interior point of the 
region. 

Corollary 5.23 A sufficient condition for throughout connectivity is the initial con- 
nectivity and that each initial node degree is not less than \m — 1. 

The corollary reveals an important fact: if the node degree exceeds a certain 
threshold (three fourth of the graph order), no edge will be disconnected, and the 
throughout connectivity reduces to initial connectivity. While conservative, this re- 
sult is simple and verifiable, and it readily applies to a phase of any consensus pro- 
cess. 

Next, we apply the approach to the multiagent networks with five or less nodes. 

The case of two-node networks is trivial, and consensus is equivalent to initial 
connectedness. For three-node networks, if the network is initially connected, then 
the consensus follows from Theorem 5.21. Otherwise, reaching consensus is equiv- 
alent to the existence of an initial edge, and the (least) distance between the initially 
isolated state to the edge is equal to or less than r. 

The case of four-node networks is more interesting, to which the proposed ap- 
proach applies either directly or indirectly. Figure 5.9 demonstrates the types of 
connected networks, where (a)-(e) verifies Theorem 5.21. For a system with initial 
interaction (f), it is clear that the sum of any two node degrees is less than or equal 
to four, which verifies inequality (5.38). This means that the connection will keep 
unchanged unless a new edge appears. On the other hand, the appearance of any 
new edge leads the network to satisfy (5.35) and (5.36). Therefore, any multiagent 
system with network (f) reaches consensus under the linear control protocol. 

The above analysis is summarized into the following proposition. 

Proposition 5.24 For a multiagent network with four or less nodes, initial connect- 
edness is equivalent to throughout connectedness. 

Finally, let us examine the multiagent networks with five nodes, which exhibit 
more diverse and complex dynamics. When the size of initial graph is fourteen or 
more, the network is always initially connected. In particular, if the size is sixteen or 



5.4 Consensus of Multiagent Systems with Proximity Graphs 

-9 






(a) 



(b) 



(c) 





(d) 
Fig. 5.9 Four-node connected networks 



(e) 



(f) 



Fig. 5.10 Connection modes 
for five-node networks 





(a) 



(b) 





(c) 



(d) 



more, then Theorem 5.21 applies, and the network is throughout connected. When 
the size is exactly fourteen, there are four connection types, which are depicted in 
Fig. 5.10. It can be easily verified that Theorem 5.21 applies to case (a). 
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Fig. 5.11 Initial connectivity with no consensus 



For case (b), the theorem is not applicable, but an analysis can be conducted 
based on Lemma 5.19. In fact, by (5.38), any edge other than (2, 3) and (3, 4) will 
keep connected if the interconnection keep unchanged. For edge (2, 3), calculate 



-r 1*3 - *2 1 2 = 2(x 3 - x 2 ) T Ux 4 - x?,) + (x 2 - x 3 ) 
at 

+ (X2 ~ x\) + (x 2 - *3) + (x 2 - x 5 )] 

I |2 TV 1 

= -6\(x3-X2)\ +2(x 3 -x 2 ) y(x 2 — Xi) + (x 4 -x 5 )J, 

which means that the length of edge (2, 3) will strictly decrease when the edge 
length is the largest among all the edges, and the edge will keep connected if the 
interconnection keep unchanged. The same property holds for edge (3,4). On the 
other hand, the introduction of any new edge leads the network to verify Theo- 
rem 5.21. As a result, the network is throughout connected in this case. 

System with initial network (c) is throughout connected due to the facts that 
inequality (5.38) holds for each edge and Theorem 5.21 applies when new edges 
appear. 

Network (d) is most interesting as disconnectedness does might happen. To see 
this, we take a one-dimensional system with 
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jci(0) = -1, jc 2 (0) = -0.95, * 3 (0) = -0.9, 
x 4 (0)=0, x 5 (0) = 0.95, r = l. 

It can be verified that the system admits network (d) as initial graph. Figure 5.11 
shows the state trajectory, where node 5 becomes isolated at time 0.083 sec. It can be 
seen that, as neighbors of x\, x$ imposes X4 going up, but x\,X2, and xj, impose X4 
going down. As a result of the "competition", X4 goes down and becomes invisible 
from X5 . This makes X5 isolated. 
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5.5.7 Problem Formulation 

A practical motivation for studying hybrid dynamical systems stems from the fact 
that the hybrid control scheme provides an effective approach for controlling highly 
nonlinear complex dynamical systems. Indeed, while linear design techniques are 
widely used in control system synthesis, as far as nonlinear dynamics are concerned, 
in practice a linear controller is only valid around a specific operating point. It is 
thus a common practice to design more than one linear controller, each at a different 
operating region and a switching mechanism that coordinates the switching among 
them. 

Consider the switched linear control system given by 

x(f) = A a(t) x(t) + B a(l) u a(t) (t), (5.40) 

where x(t) e R" is the continuous state, a(t) e {1, . . . , m] is the switching signal, 
Ui(t) eR Pi is the control input, A , e R" x " and Bj e R" x Pl ' , i e { 1 , . . . , m } , are real 
constant matrices. Denote the continuous state by <j>(t\ 0, x, u, a). 

Suppose that the system is completely controllable, that is, for any state x e R" , 
there exist a time tr > 0, a switching law a : [0, tf] h> {1, . . . , m], and inputs u, : 
[0, t f ] \-> R Pi , i e {1 , . . . , m], such that solution of the continuous state at 1 1 is the 
origin, i.e., 4>{tf\ 0, x, u, a) — 0. 

The problem of exponential stabilization is to find a control law and a switching 
law such that the switched system is exponentially stable. To be more precise, find 
a pathwise state-feedback switching law and a state-feedback control law that steer 
the controllable switched system exponentially stable. 



5.5.2 Multilinear Feedback Design 

In this subsection, we investigate the possibility of solving the stabilization problem 
with a feedback control scheme. The main idea is to associate with each subsystem 



232 5 Connections and Implications 

a set of candidate linear controllers such that the extended switched system is stabi- 
lizable. We thus can apply the design approach presented in Sect. 4.4 for calculating 
a pathwise state-feedback switching law for the extended system. 

Suppose that F- , j — 1, . . . , k,, are linear gain matrices associated with the jth 
subsystem. Then, with the linear controller 

Ui =F iX , FtG{Fl,...,F^}, 
the switched system is extended to 

x=C s x, (5.41) 

where g e {1, . . . , J2T=i b}, Q = A,- + 8^/ for i = 1, . . .,m, j = 1, ... , ki, and 

* = E£ 1 i */* + /■ 

Definition 5.25 Switched system (5.40) is multifeedback exponentially stabiliz- 
able if there exist natural numbers k\ , . . . , k m and gain matrices F, , i = 1 , . . . , m, 
j = 1, . . . , hi, such that the extended forced-free switched system (5.41) is exponen- 
tially stabilizable. In this case, the gain matrix set {F- : i — 1, . . . , m, j = 1, . . . , jfc,-} 
is a solution of the exponential stabilization problem. 

To proceed, we introduce the concept of unit sphere switched contractility. 

Definition 5.26 Switched system (5.40) is unit sphere switched contractive, if for 
any state x with unit norm, there exist a time T > 0, an input u, and a switching 
signal a such that \(p(T; 0,x, u, a)\ < 1. 

Lemma 5.27 The switched linear system is multifeedback exponentially stabiliz- 
able iff it is unit sphere switched contractive w.r.t. any given norm. 

Proof It is clear that multifeedback exponential stabilizability implies unit sphere 
switched contractility. Thus, we need only to prove the converse. 

For any arbitrarily given but fixed state x with unit norm, let T x , u , and a be such 
that |0(7^; 0, x, u, a)\ — p x < 1. Without loss of generality, we assume that state 
curve {y(t) — (p(t;0,x,u,a) : t e [0, T x ]} does not pass by the origin, otherwise 
redefine T x to be 

minjf : \<fi(t; 0,x, u, a)\ — p x }. 

Let i t = argmax" =1 |vj(?)|- It can be seen that i t is piecewise constant and yi t is 
nonzero and piecewise continuous w.r.t. t. For any t e [0, T x ], denote z = y(t), and 
define a p, • x n matrix F z by 

F z (j k)= ( (Mor C>(0);7z* if *=»«. 

otherwise. 
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It is clear that F z is well defined and piecewise continuous w.r.t. z. In addition, 
u a ( t )(t) — F z x(t). Therefore, we have 

y(t) = {Aa(t) + B a(t) F^)y(t). 

According to the continuous dependence of initial state, there exist a natural num- 
ber N, a time sequence = fo < h < tz < • • • < fjv < T x , and a constant matrix 
sequence FZ , Ff , . . . , F^ such that solution of the linear time-varying system 

w = {A a(t) + B a(t) F£)w(t), t e [t k , fjt+i), k = 0,l,.--,N, 
w(0)=x, tff+i=T x , 

satisfies \w(T x ) — y(T x )\ < -^- . Assume without loss of generality that the switch- 
ing times of a in [0, T x ] are in the set [t\, . . . , f/y}, otherwise just incorporate the 
times into the set. As 



w 



(T x ) = exp((A a(t0) + B a{to) F$)(h - to)) ■ 



def 



x exp((A a(tN ) + Btr(t N )F^)(tN+i - tN))x = <P x x, 

we have \& x x\ < -^^ < 1. 

To summarize, for any state on the unit sphere, there exist a finite number of gain 
matrices such that the associated state trajectory is norm contractive. By the standard 
arguments as in [234, Theorem 3.9], there exist multilinear feedback controllers 
for each input channel such that the extended forced-free switched linear system is 
exponentially stable. This completes the proof. □ 

It is clear that complete controllability implies unit sphere switched contractil- 
ity. According to Lemma 5.27, any controllable switched system is multifeedback 
exponentially stabilizable. 

Next, we develop a design procedure to compute a set of multifeedback gains 
such that the extended switched system is exponentially stabilizable. 

Sample the switched system into a discrete-time switched linear system 

Zk+ i = C r eX + D r e u, (5.42) 

where r > is the sampling period, q e {1 m] is the switching signal, and 

CJ — e A ' T , DT — J* exp(Ajt)dtBj, i = 1, ...,m. It has been known that the sam- 
pled system is controllable under almost all period r (see, e.g., [234, Lemma 4.53]). 
Pick up such a r. From the controllability of the sampled system, we can find a 
natural number k and an index sequence i\ , . . . , i\ such that 

r a „k[Dl,CiDi_ 1 ,...,Ci-CT 2 Dl]=n. (5.43) 

Fix a Schur stable matrix E. By perturbation analysis, for almost all matrices E r , 
the equation 

E + E* = (Cj k + DlFZ)...(Cl+DlF{) 
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admits at least one solution (F? , . .., FT which satisfies the relationships 



E + E--Cl...Cf 1 = [Dj k ,ClDl_ 1 ,...,Cl--ClDj 1 ] 



H 



A j 



(5.44) 



and 



n=n, 



H=nK+Dj x Fi), 



(5.45) 



n=n{cj k _ x +Dj k _ x Fi_ l )...(ci+DiF{). 

On the other hand, the nonsingularity of E implies the nonsingularity of (CJ. + 
DJ F T ), which in turn implies the solvability of F z . by means of FT in (5.45). A use- 
ful observation here is that, even when k > n, it is always possible to solve (5.44) 
with at most n nonzero FJ 's. 

Proposition 5.28 Suppose that lim r ^o E T — 0. For sufficiently small r, any solu- 
tion (F^, ... , FT 0/(5.44) and (5.45) is a solution of multifeedback stabilization 
problem of the continuous-time switched linear system. 

The proof is simply based on the observation that, as x — >• 0+, we have 

e (A lk +B lk Fl)T . .. e (A, l+ B n F^r _^ E 

As a result, the switched system with the multifeedback controllers is stabilizable 
by means of periodic switching signals (see, e.g., [234, Corollary 3.12]). 

While the extended switched system is consistently stabilizable by a periodic 
switching signal, the periodic switching may not be practically applaudable. In- 
deed, the switched system with such a switching is possibly with poor transient 
performance and small stability margin. For this, we use the state-feedback path- 
wise switching mechanism instead. The computational procedure for finding the 
state-feedback pathwise switching law can be found in Sect. 4.4.2. 

To summarize, to achieve stability within the multilinear feedback control 
scheme, we need to implement the following steps. 

(1) Compute a set of multilinear feedback control gain matrices. 

(1.1) Sample the switched system as in (5.42). 

(1.2) Solve (5.44) and (5.45). 

(2) Compute a state-feedback pathwise switching law. 
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Example 5.29 Consider system (5.40) with n — 3, m — 2, and 
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(5.46) 



It can be verified that the system is completely controllable. However, it has been 
shown that the system cannot be stabilized by means of (single) linear feedback 
controllers [234, Example 5.23]. 

We are to design a multilinear feedback control law and a state-feedback path- 
wise switching law that achieve exponential stability. For this, the first step is to 
sample the continuous-time system into a discrete-time controllable switched sys- 
tem. Choose the sampling rate to be r = 0.2 sec, and let 



E = 



0.1 











0.1 


-0.1 


-0.2 





0.1 



and £ = 03x3- 



By solving (5.44) and (5.45) for the sampled-data system, we obtain the feedback 
gain matrices 

F x = [-8.0276,0,-32.1765], 

F 2 = [-7.3529, -35.5013, 1.8918], 

F 3 = [-2.6700, 21.9002, -4.0833]. 



The extended forced-free system has four subsystems with matrices C, ■ — A\ + 
B[Fi, i — 1, 2, 3, and Ca, — Ai, respectively. 

The next step is to compute a state-feedback pathwise switching law. For this, 
apply the computational algorithm for stabilizing switching design presented in 
Sect. 4.4.2. Choose r = 0.3 sec (note that this sampling rate is not equal to that 
of multilinear feedback design). It can be verified that the four switching paths 



01 = U), ^2 = (2), 



03 = (3, 2, 4,1), 



04 = (3, 2, 4,1,3,2,4,1) 



are piecewise contractive w.r.t. the £i-norm. By implementing the multilinear feed- 
back control law and the state-feedback pathwise switching law, we obtain an 
extended switched system that is exponentially stable. Figure 5.12 depicts sam- 
ple state/input/switching trajectories of the switched system with initial state xo — 
[—1 1.5 l] T . The switching signal is taken from the extended system to accommo- 
date the multilinear feedbacks (for instance, when the first subsystem is activated 
with the third linear feedback controller, the switching signal is equal to 3). 
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Fig. 5.12 State/input/switching trajectories 



5.6 Notes and References 



Absolute stability of Lur'e systems has long been a stimulating motivation for non- 
linear control theory. The problem is notoriously difficult, and it is still among 
the most famous open problems in the control society. Nevertheless, remarkable 
progress has been made so far, especially for lower-dimensional systems. In par- 
ticular, Pyatnitskiy and Rapoport presented a necessary and sufficient condition 
for absolute stability of second- and third-order systems [194, 196]. Technically, 
they characterized the "most destabilizing" phase portrait using variational calcu- 
lus, and this amounts to solving a nonlinear equation with three unknowns that no 
efficient numerical verification is available in general. The idea of constructing the 
so-called most destabilizing nonlinearity is clearly related to finding a worst pos- 
sible switching strategy that makes the extreme switched linear system diverging 
with a largest rate. Along this line, several new characterizations were carried out 
[44, 112, 162, 163] that solve the problem of absolute stability for planar Lur'e sys- 
tems in a computational point of view. Other related and interesting progress can be 
found in [165, 207]. 

The algebraic criterion, Theorem 5.1 in Sect. 5.1.1, was borrowed from 
[17, 18, 44]. The application to the problem of absolute stability in Sect. 5.1.2 is 
straightforward. 
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Switching-based adaptive control can be traced back to the pioneering work by 
Fu and Barmish [84], who proposed an adaptive control scheme with multiple con- 
trollers and a sequential switching logic that disconnects the "wrong" controllers by 
evaluating the performance index. Since the 1990s, the adaptive stabilization via hy- 
brid control has witnessed a great progress, mostly in the framework of "logic-based 
supervisory control" developed by Morse and his coworkers [107, 177, 178]. While 
the design of candidate controllers/estimators is somewhat standard [6], the design 
of switching logics could be quite involved [109, 111, 178, 183]. It has been shown 
that a properly designed switching logic can not only stabilize a system with large- 
scale unknown parameters, but also improve the performances, for instance, tran- 
sient response [182] and robustness [9, 179]. For more recent progress, the reader is 
referred to [19, 214] and the references therein. 

The switching adaptive scheme presented in Sect. 5.2 is a simplified and com- 
bined version taken from [6, 109]. In particular, Sect. 5.2.1 was adopted from [6], 
and Sect. 5.2.2 was adopted from [109]. Lemma 5.18 was taken from [108], and the 
numerical example in Sect. 5.2.3 was taken from [6]. 

A fuzzy system is a dynamical system based on fuzzy logic, which was first initi- 
ated by Zadeh in the 1960s [272, 273]. Several types of fuzzy models have been pro- 
posed, among which the T-S fuzzy systems (known also as Type-3 fuzzy systems) 
have gained more and more attention and recognition [215, 244]. A T-S fuzzy sys- 
tem uses fuzzy rules to describe the global nonlinear dynamics by means of a set of 
local linear modes that are smoothly connected by fuzzy membership functions. The 
clear two-level "execution-supervisor" structure makes it powerful in approximat- 
ing general nonlinear systems and flexible in high-level design [5 1 , 248] . Note that if 
we take the IF-THEN fuzzy logic as a switching logic, then a T-S system is closely 
related to the corresponding switched system. Therefore, stability analysis for fuzzy 
systems can be benefited from stability analysis for switched systems. Much ear- 
lier effort has been paid to present stability criteria based on common quadratic 
Lyapunov functions [247], and later it was extended to the piecewise quadratic Lya- 
punov approach that may lead to less conservative criteria [76, 127]. Most criteria 
can be expressed in terms of linear matrix inequalities (LMIs), which permits effi- 
cient numerical solvers [46]. Despite a remarkable progress made so far, stability 
analysis is still a challenging problem to be solved. The reader is referred to the 
surveys [77, 248] and the references therein for more details. 

The framework and stability criteria in Sect. 5.3 were mainly adopted from 
[76, 127]. The piecewise switched linear system is a straightforward extension of 
a piecewise system with a set of switched linear systems as subsystems. Propo- 
sition 5.12 simply combines the piecewise quadratic Lyapunov function approach 
with transition analysis among the partitions. 

The consensus or agreement problem for multiagent systems is a typical prob- 
lem in distributed computational intelligence, which is to achieve a common value 
asymptotically by means of proper cooperative control among the agents in a dis- 
tributed manner. Numerous linear/nonlinear protocols have been proposed to solve 
the problem in the literature. In particular, with the aid of the Laplacian matrix the- 
ory, the problem was tackled in an elegant manner by means of linear protocols for 
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multiagent systems with either static or dynamic connections [75, 153, 187]. A mul- 
tiagent system with a linear protocol is exactly a piecewise linear system, and the 
consensus analysis can be conducted based on stability of piecewise linear systems. 
It was established that, under the linear feedback protocol and the assumption that 
the network is always connected, the system admits a common quadratic Lyapunov 
function, and asymptotic consensus is achieved. This was summarized in Sect. 5.4.2, 
where a first-order differential equation was used for simplification. 

While the connectedness assumption in Theorem 5.17 can be further relaxed 
in various manners (see, e.g., [113, 120, 175]), the verification of the connectivity 
assumptions are not tractable for dynamic network interconnections. To tackle this 
issue, one way is to seek for nonlinear protocols as in [121, 275]. Alternatively, by 
combining the transition analysis presented in Sect. 3.3.4 and a novel Lyapunov- 
like function method, we can estimate a set of initial configurations that is in fact 
invariant and attractive, and hence the requirement of throughout connectivity can 
be removed. This was first presented in [237], from which Sect. 5.4.3 was adopted. 

For switched linear control systems, the problem of stabilization by means of si- 
multaneous switching/control design is both important and challenging. A primary 
reason for this lies in the fact that a nontrivial gap exists between controllability 
and feedback stabilizability. To be more precise, it was revealed that controllability 
does not imply feedback stabilizability if one linear feedback controller is attached 
to a subsystem [234]. However, when more than one controller is allowed to con- 
nect with a subsystem, controllability does imply stabilizability [242, 268, 269]. 
Therefore, a natural way to address the problem of stabilization, as adopted here in 
Sect. 5.5.2, is first to introduce multiple controllers that not necessarily connect with 
the subsystems in a one-to-one manner and then to design a state-feedback path- 
wise switching law for the (extended) switched system. The notion of unit sphere 
switched contractility given in Definition 5.26 and its connection with stabilizabil- 
ity were borrowed from [228]. The design procedure of calculating multifeedback 
gains was a combination of that presented in [242, 268]. For more recent progress 
on the problem of stabilization, the reader is referred to [238, 243, 279]. 
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